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FOREWORD 


Taxonomy--''Classification, esp. of animals and 
plants according to their natural relationships ... 4 

Most readers will have heard of the biological taxono- 
mies which permit,classification into such categories as 
phyllum, class, order, family, genus, species, variety. 
Biologists have found their taxonomy markedly helpful as a 
means of insuring accuracy of communication about their 
science and as a means of understanding the organization 
and interrelation of the various parts of the animal and plant 
world. You are reading about an attempt to build a tax- 
onomy of educational objectives. It is intended to provide 
for classification of the goals of our educational system. 
It is expected to be of general help toall teachers, admini- 
strators, professional specialists, and research workers 
who deal with curricular and evaluation problems. It is 
especially intended to help them discuss these problems 
with greater precision. For example, some teachers be- 
lieve their students should "really understand," others de- 
sire their students to "internalize knowledge," still others 
want their students to "grasp the core or essence" or "com- 
prehend." Do they all mean the same thing? Specifically, 
what does a student do who "really understands" which he 
does not do when he does not understand? Through refer- 
ence to the taxonomy as a set of standard classifications, 
teachers should be able to define such nebulous terms as 
those given above. This should facilitate the exchange of 
information about their curricular developments and evalu- 
ation devices. Such interchanges are frequently disappoint- 
ing now because all too frequently what appears to be com- 
mon ground between schools disappears on closer exami- 
nation of the descriptive terms being used. 


But beyond this, the taxonomy should be a source of 
constructive help on these problems. Teachers building a 
j 7 T m aoe 

Webster's New Collegiate Dictionary, Springfield, 


Mass.: G. & C. Merriam Co., 1953, p. 871. 
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curriculum shouldfind here a range of possible educational 
goals or outcomes in the cognitive area ("cognitive" is used 
to include activities such as remembering and recalling 
knowledge, thinking, problem solving, creating). Compar- 
ing the goals of their present curriculum with the range of 
possible outcomes may suggest additional goals they may 
wish to include. As a further aid, sample objectives cho- 
sen from a range of subject-matter fields (though mostly 
from the upper educational levels) are used to illustrate 
each of the taxonomy categories. These may be suggestive 
of the kinds of objectives that could be included in their 
own curriculum. 


Use of the taxonomy can also help one gain a perspec- 
tive on the emphasis given to certain behaviors by a par- 
ticular set of educational plans. Thus, a teacher, in clas- 
sifying the goals of a teaching unit, may find that they all 
fall within the taxonomy category of recalling or remember- 
ing knowledge. Lookingatthetaxonomy categories may sug- 
gest to him that, for example, he could include some goals 
dealing with the application of this knowledge and with the 
analysis of the situations in which the knowledge is used. 


Curriculum builders should find the taxonomy helps 
them to specify objectives so that it becomes easier to plan 
learning experiences and prepare evaluation devices. To 
return to the illustration of the use of the term "understand- 
ing," a teacher might use the taxonomy to decide which of 
several meanings he intended. If it meant that the student 
was sufficiently aware of a situation or phenomenon to de- 
Scribe it in terms slightly different from those originally 
used in describing it, this would correspond to the taxonomy 
category of "Translation." Deeper understanding would be 
reflected in the next-higher level of the taxonomy, "Inter- 
pretation," where the student would be expected to summa- 
rize and explain the phenomenon in his description. And 
there are other levels of the taxonomy which the teacher 
could use to indicate still deeper "understanding." In short, 
teachers and curriculum makers should find this a rela- 
tively concise model for the analysis of educational out- 
comes in the cognitive area of remembering, thinking, and 
problem solving. 
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Once they have classified the objectives they wish to 
measure, teachers and testers working on evaluation prob- 
lems may refer to the discussions of the problems of meas- 
uring such objectives. The Handbook includes constructive 
suggestions for measuring each class of objectives and of- 
fers a number of examples of the different item types which 
have been used by examiners. 


Some research workers have found the categories of 
use as a framework for viewing the educational process and 
analyzing its workings. For instance, the AERA Com- 
mittee on Criteria of Teacher Effectiveness suggests its 
use in analyzing the teacher's success in classroom teach- 
ing. 2 Bloom used them in analyzing the kinds of learning 
that take place in class discussions. Equally important, 
the psychological relationships employed by the classifica- 
tion scheme are suggestive of psychological investigations 
which could further our understanding of the educational 
process and provide insight into the means by which the 
learner changes in a specified direction. 


But any of these uses demands a clear understanding 
of the structure of the taxonomy, its principles of construc- 
tion, and its organization. We hope this can be easily ac- 
quired by a study of the introductory chapters. In addition, 
itis suggested that the reader refer early and repeatedly 
to the condensed version of the taxonomy which has been 
placed at the back of the book in an appendix for easy ref- 
erence. The condensed version gives an over-all view of 
the classification system, brief definitions ofthe categories, 
and afew examples of the objectives belonging in each cate- 
gory. For quick reference and a general grasp of the pro- 
ject, the condensed version of the taxonomy will be found 
to be one of the most valuable parts of the book. The brief 
overview of historical background plus the description of 
problems and of the organization of the taxonomy project 
found in the remainder of this Foreword should further 


2Remmers, H. H., et al, "Report of the Committee on 
the Criteria of Teacher Effectiveness, " Review of Educa- 
tional Research, 22 (1952), pp. 245,246. ED 

3pBloom, B. S., "The Thought Processes of Students 
in Discussion," in Sydney J. French, Accent on Teaching, 
New York: Harper & Bros., 1954. ig 
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orient the reader. Part I of the Handbook is intended to 
develop some insight into the principles of development and 
organization of the taxonomy, to develop an understanding 
of the nature and significance of the cognitive domain, and 
to give some help on the manner in which objectives may 
be classified in the taxonomy. 


Part II is the taxonomy proper. It consists of the tax- 
onomy categories, sequentially arranged as listed in the 
condensed version and in the Table of Contents. Each one 
of the categories contains, in order: (1) a definition of the 
category; (2) illustrative objectives; (3) a discussion of 
problems and considerations in testing objectives in the 
category; and (4) examples of items testing objectives in 
the category. Each test example is briefly discussed to 
note what is required of the student and how this is achieved. 


History 


The idea for this classification system was formed at 
an informal meeting of college examiners attending the 1948 
American Psychological Association Convention in Boston. 
At this meeting, interest was expressed in a theoretical 
framework which could be used to facilitate communication 
among examiners. This group felt that sucha framework 
could do much to promote the exchange of test materials 
and ideas about testing. In addition, it could be helpful in 
stimulating research on examining and on the relations be- 
tween examining and education. After considerable discus- 
sion, there was agreement that such a theoretical framework 
might best be obtained through a system of classifying the 
goals of the educational process, since educational objec- 
tives provide the basis for building curricula and tests and 
represent the starting point for much of our educational 
research. 


This meeting became the first of a series of informal 
annual meetings of college examiners. Gathering ata dif- 
ferent university each year and with some changes in mem- 
bership, this group has considered the problems involved 
in organizing a classification of educationalobjectives. The 
group has also considered a great many other problems of 
examining and of educational research. This is the first 
product of these meetings. 
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The committee named on the title page was delegated 
the task of organizing and writing the various parts of the 
"cognitive" portion of the taxonomy, while the group con- 
tinued in its efforts to develop the "affective" portion of the 
taxonomy. As yet, however, the group is still an informal 
one without dues, regular membership, or the usual offi - 
cers. Under such conditions, the committee and the editor 
must take responsibility for the present product, although 
"credit" for ideas, suggestions, and sound criticism should 
be distributed more widely among all those who have at- 
tended one or more meetings of the group. 


Problems 


One of the first problems raised in our discussions 
was whether or not educational objectives could be classi- 
fied. It was pointed out that we were attempting to classify 
phenomena which could not be observed or manipulated in 
the same concrete form as the phenomena of such fields as 
the physical and biological sciences, where taxonomies of 
a very high order have already been developed. Neverthe- 
less, it was the view of the group that educationalobjectives 
stated in behavioral form have their counterparts in the 
behavior of individuals. Such behavior can be observed 
and described, and these descriptive statements can be 
classified. 


There was some concern expressed in the early meet- 
ings that the availability of thetaxonomy might tend to abort 
the thinking and planning ofteachers with regard to curric- 
ulum, particularly if teachers merely selected what they 
believed to be desirable objectives from the list provided 
in the taxonomy. The process of thinking about educational 
objectives, defining them, and relating them to teaching and 
testing procedures was regarded as a very important step 
on the part of teachers. It was suggested that the taxonomy 
could be most useful to teachers who have already gone 
through some of the steps in thinking about educational ob- 
jectives and curriculum. 


Some fear was expressed that the taxonomy might lead 
to fragmentation and atomization of educational purposes 
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such that the parts and pieces finally placed into the clas- 
sification might be very different from the more complete 
objective with which one started. Although this was recog- 
nized as a very real danger, one solution for this problem 
appeared to be setting the taxonomy at alevel of generality 
where the loss by fragmentation would not be too great. 
The provision of major categories as wellas subcategories 
in the taxonomy enables the user of the taxonomy to select 
the level of classification which does least violence to the 
statement of theobjective. Further, the hierarchical char- 
acter of the taxonomy enables the user to more clearly 
understand the place of a particular objective in relation to 
other objectives. 


Organizational principles 


In discussing the principles by which a taxonomy might 
be developed, it was agreed that the taxonomy should be an 
educational - logical - psychological classification system. 
The terms in this order express the emphasis placed on 
the different principles by which the taxonomy could be de- 
veloped, Thus, first importance should be given to educa- 
tional considerations. Insofar as possible, the boundaries 
between categories should be closely related to the distinc- 
tions teachers make in planning curricula or in choosing 
learning situations. It is possible that teachers make dis- 
tinctions which psychologists would not make in classifying 
or studying human behavior. However, if one of the major 
values of the taxonomy is in the improvement of communi- 
cation among educators, then educational distinctions should 
be given major consideration, Second, the taxonomy should 
be a logical classification in that every effort should be 
made to define terms as precisely as possible and to use 
them consistently. Finally, the taxonomy should be con- 
sistent with relevant and accepted psychological principles 
and theories, 


It was further agreed that inconstructing the taxonomy 
every effort should be made to avoid value judgments about 
objectives and behaviors. Neutrality withrespect to educa- 
tional principles and philosophies was to be achieved by 
constructing a system which, insofar as it was possible, 


would permit the inclusion of objectives from all educa- 
tional orientations. Thus, it should be possible to classify 
all objectives which can be stated as descriptions of stu- 
dent behavior. 


Three domains--cognitive, affective, and psychomotor 


Our original plans called for a complete taxonomy in 
three major parts- -the cognitive, the affective, and the 
psychomotor domains. The cognitive domain, which is the 
concern of this Handbook, includes those objectives which 
deal with the recall or recognition of knowledge and the de- 
velopment of intellectual abilities and skills. This is the 
domain which is most central to the work of much current 
test development. It is the domain in which most of the 
work in curriculum development has taken place and where 
the clearest definitions of objectives are tobe found phrased 
as descriptions of student behavior. For these reasons we 
started our work here, and this is the first of our work to 
be published. 


A second part of the taxonomy is the affective domain. 
It includes objectives which describe changes in interest, 
attitudes, andvalues, and the development of appreciations 
and adequate adjustment. Much of our meeting time has 
been devoted to attempts at classifying objectives under 
this domain, It has been a difficult task which is still far 
from complete. Several problems make it so difficult. 
Objectives in this domain are not stated very precisely; 
and, in fact, teachers do not appear to be very clear about 
the learning experiences which are appropriate to these 
objectives. It is difficult to describe the behaviors appro- 
priate to these objectives since the internal or covert feel- 
ings and emotions are as significant for this domain as are 
the overt behavioral manifestations. Then, too, our test- 
ing procedures for the affective domain are stillin the most 
primitive stages. We hope to complete the task but are not 
able to predict a publication date. 


A third domainis the manipulative or motor-skill area. 
Although we recognize the existence of this domain, we find 
so little done about it in secondary schools or colleges, 
that we do not believe the development ofa classification 
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of these objectives would be very useful at present. We 
would appreciate comments on this point from teachers and 
other educational workers who are especially interested in 
this domain of educational objectives. 


Development of the cognitive domain 


We were naturally hesitant about publishing the cogni- 
tive-domain handbook without securing as widespread com- 
ment andcriticism as possible. Members of the group have 
discussed the taxonomy with their colleagues in their own 
institutions, with graduate students in curriculum and test- 
ing, and with other groups of teachers and educational spe- 
cialists. The criticisms and suggestions of these groups 
have, whenever possible, been taken into consideration in 
the present volume. A somewhat more formal presentation 
was made ina symposium at the American Psychological 
Association meetings in Chicago in 1951.4 


In spite of these means of communication, we still felt 
the need for the comments, suggestions, and criticisms of 
alargerand more representative group of educators, teach- 
ers, and educational research workers. With this in mind, 
we were very pleased when Longmans, Green and Company 
agreed to print a preliminary edition of 1000 copies before 
printing the finalversion of the Handbook. The preliminary 
edition was sent to a large group of college and secondary 
Schoolteachers, administrators, curriculum directors, and 
educational research specialists, This group was asked to 
read the preliminary edition carefully and to offer criti- 
cisms and suggestions, as well as additional illustrations 
ofobjectives and test materials. They responded very gen- 
erously and the present version of the Handbook has taken 
many of theirideas into consideration. We aretruly grate- 
ful for the time and thought given to this work. 

t Symposium: The Development of a Taxonomy of Edu- 
cational Objectives, H. H. Remmers, Chairman. Partici- 
pants: B. S. Bloom, Intellectual domain; D. R. Krathwohl, 
Affective domain, Discussants: O, K. Buros, O. H. Mowrer, 
and J. M. Stalnaker.  Fifty-ninth Annual Meeting of the 
American Psychological Association, August 31-September 
5, Chicago, Illinois. 
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Thus, this Handbook is truly a group product. It is the 
direct outgrowth of the thinking of over thirty persons who 
attended the taxonomy conferences. It is based on the work 
of countless test constructors, curriculum workers, and 
teachers. Several hundred readers of the preliminary edi- 
tion have contributed criticisms, suggestions, and illustra- 
tive materials. The committee which took responsibility 
for the actual writing hope that this Handbook justifies the 
enormous amount of time and effort devoted to it by the 
many persons involved. We regard the work as well worth 
the effort if the taxonomy is found of value as ameans of 
communicating within the field of education, We submit it 
in the hope that it willhelp to stimulate thought and research 
on educational problems. 


Since this is a handbook in which a classification scheme 
is described and illustrated, the reader is cautioned against 
attempting to read it as though it were a narrative or an ex- 
position of a point of view which could easily be read from 
cover to cover. The reader may find it profitable to read 
the introduction and the condensed version of the taxon- 
omy in the Appendix in order to get a quick overview of 
the entire book. The chapter on educational objectives and 
curriculum development followed by the chapter on the clas- 
sification of educational objectives and test exercises will 
enable him to secure a more thorough understanding of 
the taxonomy and its possible uses. The remaining sec- 
tions of the volume--the taxonomy with illustrative objec- 
tives and test items--should be read as the reader finds 
these sections relevant to specific teaching, curriculum, 
testing and research problems. 


CHAPTER 1 


THE NATURE AND DEVELOPMENT 
OF THE TAXONOMY 


The taxonomy as a classification device 


The major purpose in constructing a taxonomy of edu- 
cational objectives is to facilitate communication, In our 
original consideration of the project we conceived of it as 
a method of improving the exchange of ideas and materials 
among test workers, as well as other persons concerned 
with educational research and curriculum development. 
For instance, the use of the taxonomy as an aid in devel- 
oping a precise definition and classification of such vaguely 
defined terms as "thinking" and "problem solving" would 
enable a group of schools to discern the similarities and 
differences among the goals of their different instructional 
programs. They could compare and exchange tests and 
other evaluative devices intended to determine the effec- 
tiveness of these programs. They could, therefore, begin 
to understand more completely the relation between the 
learning experiences provided by these various programs 
and the changes which take place in their students. 


Set at this level, the task of producing a taxonomy, that 
is, a classification of educationaloutcomes, is quite analo- 
gous to the development of a plan for classifying books in a 
library. Or, put more abstractly, it is like establishing 
symbols for designating classes of objects where the mem- 
bers of a class have something in common. Ina library 
these symbols might be the words "fiction" and "nonfiction" 
and would apply to classes of books having something in 
common. If the problem is essentially one of finding new 
symbols for the classes, any set of symbols, numbers, 
nonsense syllables, or words could be used. Thus, we 
could have used the symbols "F" and "NF" for fiction and 
nonfiction, Further, since the symbols selected are not 
intended to convey that one class is of a higher order than 
another or that thereis any particular relationship between 
the classes, they can be selectcd in very arbitrary fashion. 
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The labels "fiction" and "nonfiction" do not imply that the 
one class of book is better, more abstract, or more com- 
plex than the other kind. 


Of course, such a classification procedure cannot be 
a private fantasy since it is of value only if used by the work- 
ers who wish to communicate with each other. Thus, the 
classifications "fiction" and "nonfiction" are of value only 
if librarians use them. Acceptance of such classifications 
by potential users is likely to be facilitated if the class 
names are terms which are reasonably familiar to them 
and if these terms are given precise and usable definitions. 
Thus, one might expect more ready acceptance of a library 
classification scheme if he took such a term as "fiction,! 
which is already in use, and defined it so that any com- 
petent librarian would easily be able to determine which 
books fit the classification. 


In summary then, the major task in setting up any kind 
of taxonomy is that of selecting appropriate symbols, giv- 
ing them precise and usable definitions, and securing the 
consensus of the group which is to use them. Similarly, 
developing a classification of educational objectives requires 
the selection of an appropriate list of symbols to represent 
all the major types of educational outcomes. Next, there 
is the task of defining these symbols with sufficient preci- 
sion to permit and facilitate communication about these 
phenomena among teachers, administrators, curriculum 
workers, testers, educational researchworkers, andothers 
who are likely to use the taxonomy. Finally, there is the 
task of trying the classification and securing the consensus 
of the educational workers who wish to use the taxonomy. 


What is to be classified 


Before one can builda classification scheme, it must 
be clear what it is that is to beclassified. This is not much 
of a problem when one is classifying books. But descrip- 
tions of curricula are set up on such different bases as de- 
scriptions of teacher behavior, descriptions of instructional 
methods, and descriptions of intended pupil behaviors, As 
achievement testers and educational research workers, the 
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major phenomena with which we are concerned are the 
changes produced in individuals as a result of educational 
experiences. Such changes may be represented by the global 
statements of the educational objectives of an educational 
unit, or they may be represented by the actual description 
of the student behaviors which are regarded as appropriate 
or relevant to the objectives. Objectives may also be in- 
ferred from the tasks, problems, and observations used to 
test or evaluate the presence of these behaviors. 


We are of the opinion that although the objectives and 
test materials and techniques maybe specified in an almost 
unlimited number of ways, the student behaviors involved 
in these objectives canbe represented by a relatively small 
number of classes. Therefore, this taxonomy is designed 
to be a classification of the student behaviors which repre- 
Sent the intended outcomes of the educational process. It 
is assumed that essentially the same classes of behavior 
may be observed in the usual range of subject-matter con- 
tent, at different levels of education (elementary, high- 
School, college), and in different schools. Thus, a single 
Set of classifications should be applicable in all these in- 
stances, 


It should be noted that we are not attempting to clas- 
sify the instructional methods used by teachers, the ways 
in which teachers relate themselves to students, or the 
different kinds of instructional materials they use. We are 
not attempting to classify the particular subject matter or 
content, What we are classifying is the intended behavior 
of students--the ways in which individuals are to act, think, 
or feel as the result of participating in some unit of in- 
struction, (Only such of these intended behaviors as are 
related to mental acts or thinking are included in the part 
of the taxonomy developed in this Handbook, ) 


It is recognized that the actual behaviors of the stu- 
dents after they have completed the unit of instruction may 
differ in degree as well as inkind from the intended behav- 
iors specified by the objectives. That is, the effects of 
instruction maybe such that the students do not learna given 
skill to the desired level of perfection; or, for that mat- 
ter, they may not develop the intended skill to any degree. 
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This is a matter of grading or evaluating the goodness of 
the performance, The emphasis in the Handbook is on ob- 
taining evidence onthe extent to which desired and intended 
behaviors have been learned by the student, It is outside 
the scope of the task we set ourselves to properly treat the 
matter of determining the appropriate value to be placed 
on the different degrees of achievement of the objectives 
of instruction. 


It should also be noted that the intended behaviors spec- 
ified by educational objectives do not include many of the 
behaviors which psychologists are interested in classifying 
and studying. One reason is that the intended behaviors 
represent the social goals imposed upon youngsters by their 
Society or culture. Thus, the intended or desiredbehaviors 
included in educational objectives usually do not include 
undesirable or abnormal behaviors which are socially dis- 
approved. Similarly, certain natural or unsocialized be- 
haviors which might be of interest to psychologists may 
fall outside the categories of the taxonomy. 


Our present studies ofthe affective area have indicated 
that the selective nature of intended behaviors will be even 
more apparent there than in the cognitive domain, The fact 
that we include objectives which specify social and emotional 
adjustment as a part of the affective domain points up this 
fact. 


Guiding principles 


Since the determination of classes and their titles is in 
some ways arbitrary, there couldbe an almost infinite num- 
ber of ways of dividing and naming the domains of educa- 
tional outcomes. To guide us in our selection ofa single 
classification system and to make the product more readily 
understood and used, we established certain guiding prin- 
ciples. First, since the taxonomy is to be used in regard 
to existing educational units and programs, we are of the 
opinion that the major distinctions between classes should 
reflect, inlarge part, the distinctions teachers make among 
student behaviors. These distinctions are revealed in the 
ways teachers state educational objectives. They are also 
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found in their curricular plans, their instructional material, 
and their instructional methods. To the extent it was pos- 
sible, the subdivisions of the taxonomy are intended to rec- 
ognize these distinctions. 


A second principle is that the taxonomy should be logi- 
cally developed and internally consistent, Thus, each term 
should be defined and used in a consistent way throughout 
the taxonomy. In addition, each category should permit 
logical subdivisions which can be clearly defined and fur- 
ther subdivided to the extent that appears necessary and 
useful. 


A third principle is that the taxonomy should be con- 
sistent with our present understanding of psychological phe- 
nomena. Those distinctions which are psychologically un- 
tenable, even though regularly made by teachers, would 
be avoided. Further, distinctions which seem psycho- 
logically important, even though not frequently made in edu- 
cational objectives, would be favorably considered for in- 
clusion. Perhaps it should be reiterated that, since the 
taxonomy deals only with educationally intended behavior, 
it falls considerably short of being a classification scheme 
for all psychological phenomena. 


A fourth principle is that the classification should be a 
purely descriptive scheme in which every type of educa- 
tional goal can be represented ina relatively neutral fashion . 
Thus, the Dewey decimal classification system for libraries 
describes all the classes of books. It does not indicate the 
value or quality of one class as compared with another, nor 
does it specify the number and kind of books any particular 
library should possess. Similarly, to avoid partiality to 
one view of education as opposed to another, we have at- 
tempted to make the taxonomy neutral by avoiding terms 
which implicitly convey value judgments and by making the 
taxonomy as inclusive as possible. This means that the 
kinds of behavioral changes emphasized by any institution, 
educational unit, or educational philosophy can be repre- 
sented in the classification, Another way of saying this is 
that any objective which describes an intended behavior 
should be classifiable in this system, On the other hand, 
the taxonomy will probably include a greater variety of 
behaviors than those emphasized by any one school, course, 
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or educational philosophy. Thus, one course might have 
objectives classifiable in four of the categories, another in 
only three of the categories, and so on. 


In one sense, however, the taxonomy is not completely 
neutral. This stems from the already-noted fact that it is 
a classification of intended behaviors. It cannot be used to 
classify educational plans which are made in such a way 
that either the student behaviors cannot be specified or only 
a single (unanalyzed) term or phrase such as "understand- 
ing," or "desirable citizen," is used to describe the out- 
comes. Only those educational programs which can be 
specified in terms of intended student behaviors can be 
classified. 


Developing the taxonomy 


Keeping in mind the aforementioned principles, we be- 
gan work by gathering a large list of educational objectives 
from ourowninstitutions andthe literature. We determined 
which part of the objective stated the behavior intended and 
which stated the content or object of the behavior. We then 
attempted to find divisions or groups into which the behav- 
iors could be placed. We initially limited ourselves to 
those objectives commonly referredto as knowledge, intel- 
lectual abilities, and intellectual skills. (This area, which 
we named the cognitive domain, may also be described as 
including the behaviors: remembering; reasoning; problem 
solving; concept formation; and, to a limited extent, crea- 
tive thinking.) We proceeded to divide the cognitive objec- 
tives into subdivisions from the simplest behavior to the 
most complex. We then attempted to find ways of defining 
these subdivisions in such a way that all of us working with 
the material could communicate with each other about the 
specific objectives as wellas the testing procedures to be 
included. 


We have not succeeded in finding a method of classifi- 
cation which would permit complete and sharp distinctions 
among behaviors. (This is discussed in more detail in 
Chapter 3, which considers the problem of classifying ob- 
jectives and test exercises.) There are two basic views. 
First, we were again made aware of what any teacher 


knows—two boys may appear to be doing the same thing; 
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put if we analyze the situation, we find they are not. For 
example, two students solve an algebra problem. One 
student may be solving it from memory, having had the 
identical problem in class previously. The other student 
has never met the problem before and musi reason out the 
solution by applying general principles. . We can only dis- 
tinguish between their behaviors as We analyze the relation 
between the problem and each student's background of ex- 
perience. This then introduces a new aspect to the classi- 
fication problem, namely, the experiential backgrounds of 
the students to whom the objective is to apply. As is indi- 
cated in Chapter 3, this may be a very important factor in 
using the taxonomy to classify test exercises. 


A second difficulty in classification results from the 
fact that the more complex behaviors include the simpler 
behaviors. If we view statements of educational objectives 
as intended behaviors which the student shall display at the 
end of some period of education, we can then view the pro- 
cess as one of change. As teachers we intend the learning 
experiences to change the student's behavior from a sim- 
pler type to another more complex one which in some ways 
at least will include the first type. 


One may take the Gestalt point of view that the complex 
behavior is more than the sum of the simpler behaviors , 
or one may view the complex behavior as being completely 
analyzable into simpler components, But either way, so 
long as the simpler behaviors may be viewed as components 
of the more complex behaviors, we can view the educational 
process as one of building on the simpler behavior. Thus, 
a particular behavior which is classified in one way ata 
given time may develop and become integrated with other 
behaviors to form a more complex behavior which is clas- 
sified in a different way. In order to find a single place for 
each type of behavior, the taxonomy must be organized from 
simple to complex classes of behavior. Furthermore, for 
consistency in classification, a rule of procedure may be 
adopted suchthat a particular behavior is placed in the most 
complex class which is appropriate and relevant. 


But, having specified that the classes shallbe arranged 
from simple to complex, we have exceeded the simple clas- 
sification scheme which called primarily for a series of cate~ 
gories without order or rank, The next section addresses 
itself to this problem. 


= 
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The problem of a hierarchy—classification versus taxonomy 

We have so far used the terms "classification" and 
"taxonomy" more or less interchangeably. Itis necessary, 
however, that we examine the relationship between these 
terms because, strictly speaking, they are not interchange- 
able.  Taxonomies, particularly Aristotelian taxonomies, 
have certain structural rules which exceed in complexity 
the rules of a classification system. While a classification 
scheme may have many arbitrary elements, a taxonomy 
scheme may not, A taxonomy must be so constructed that 
the order of the terms must correspond to some "real" 
order among the phenomena represented by the terms. A 
classification scheme may be validated by reference to the 
criteria of communicability, usefulness, and suggestive- 
ness; while a taxonomy must be validated by demonstrating 
its consistency with the theoretical views in research find- 
ings of the field it attempts to order. 


As educators and specialists inresearch, we are inter- 
ested in along-term inquiry into the nature of the phenomena 
with which we deal, and no simple set of terms and defini- 
tions by itself really is a satisfactory tool in making this 
inquiry. We need a method ofordering phenomena such that 
the method of ordering reveals significant relationships 
among the phenomena. This is the basic problem of a tax- 
onomy—to order phenomena in ways which willreveal some 
of their essential properties as well as the interrelation- 
ships among them, Members of the taxonomy group spent 
considerable time in attempting to find a psychological the- 
ory which would provide asoundbasis for ordering the cate- 
gories of the taxonomy. We reviewed theories of personality 
and learning but were unable to find a single view which, in 
our opinion, accounted for the varieties of behaviors repre- 
sented inthe educational objectives we attempted to classify. 
We were reluctantly forcedto agree with Hilgard! that each 
theory of learning accounts for some phenomena very well 
but is less adequate in accounting for others. What is needed 
is alarger synthetic theory of learning thanat present seems 
to be available. We are of the opinion that our method of 
ordering educational outcomes will make it possible to define 
el Bileard’ B5 R5 i 

Hilgard, E. R., Theories of Learning (Century Psy- 
chology Series), New York: Appleton— Century — Crofts,1948. 
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the range of phenomena for which such a theory must ac- 
count. The taxonomy also uses an order consistent with 
research findings and it should provide some clues as to 
the nature of the theory which may be developed. This is 
an extremely complex problem ; and although it has prob- 
ably not been solved completely satisfactorily, it is the 
opinion of the writers that we have made some progress 
toward a solution. 


As the taxonomy is now organized, it contains six ma- 
jor classes: 
.00 Knowledge 
.00 Comprehension 
Application 
.00 Analysis 
.00 Synthesis 
.00 Evaluation 


ourwnr 
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Although it is possible to conceive of these major classes 
in several different arrangements, the present one appears 
to us to represent something of the hierarchical order of 
the different classes of objectives. As we have defined 
them, the objectives in one class are likely to make use of 
and be built on the behaviors found in the preceding classes 
in this list. The reader is referred to the condensed ver- 
sion of the taxonomy in the Appendix for a brief definition 
of each class and its subclasses. Fuller treatment of the 
taxonomy will be found in Part II of this volume. 


Our attempt to arrange educational behaviors from sim- 
ple to complex was based onthe idea that a particular simple 
behavior may become integrated with other equally simple 
behaviors toform amore complex behavior. Thus our clas- 
sifications may be said to be in the form where behaviors 
of type A form one class, behaviors of type AB form alr 
other class, while behaviors of type ABC form still another 
class. If this is the real order from simple to complex, it 
should be related to an order of difficulty such that prob- 
lems requiring behavior A alone should be answered cor- 
rectly more frequently than problems requiring AB. We 
have studied a large number of problems occurring in our 
comprehensive examinations and have found some evidence 
to support this hypothesis. Thus, problems requiring knowl- 
edge of specific facts are generally answered correctly more 
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frequently than problems requiring a knowledge of the uni- 
versals and abstractions in a field. Problems requiring 
knowledge of principles and concepts are correctly answered 
more frequently than problems requiring both knowledge of 
the principle and some ability to apply it in new situations. 
Problems requiring analysis and synthesis are more diffi- 
cult than problems requiring comprehension. Scatter plots 
of the performances of individuals on one test composed of 
items at a simple level in the taxonomy against their per- 
formances on another test composed of items at a more 
complex level in the taxonomy show that it is more common 
to find that individuals have low scores on complex prob- 
lems and high scores on the less complex problems than 
the reverse. Our evidence on this is not entirely satisfac- 
tory, but there is an unmistakable trend pointing toward a 
hierarchy of classes of behavior which is in accordance with 
our present tentative classification of these behaviors. 


While we have been primarily concerned with the cog- 
nitive domain, we have done some thinking about the clas- 
sification versus taxonomy problem as it applies to all the 
domains. The arrangement of behaviors from simple to 
complex and the differentiation of behaviors into three do- 
mains—the cognitive, the psychomotor, and the affective— 
were made primarily from an educational viewpoint. That 
is, these are the distinctions which teachers make in the 
development of curriculum and teaching procedures. We 
as educational testers also make similar distinctions. As 
we examine the classification system so far developed, 
however, we note an additional dimension not usually con- 
sidered in educational and teaching procedures. One of the 
major threads running through all the taxonomy appears to 
be a scale of consciousness or awareness. Thus, the be- 
haviors in the cognitive domain are largely characterized 
by a rather high degree of consciousness on the part of the 
individual exhibiting the behavior, while the behaviors in 
the affective domain are much more frequently exhibited 
with a low level of awareness on the part of the individual. 
Further, in the cognitive domain especially, it appears that 
as the behaviors become more complex, the individual is 
more aware of their existence. We are of the opinion that 
this applies to the other domains as well. Clearly there is 
no precise scale of consciousness which may be used to 
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test these speculations. However, some of our research 
on the thought processes involved in problem solving^ indi- 
cates that students are able to give more complete reports 
of their attack on a problem as the problem becomes more 
complex, that is, as the problem is classified in the more 
complex classes of intellectual abilities and skills. 


If the level of consciousness can be demonstrated tobe 
an important dimension in the classification of behavior, it 
would pose a great range of problems and point to a whole 
new set of relationships which would be of interest to re- 
searchers in the field of educationalpsychology. One might 
hope that it would provide a basis for explaining why behav- 
iors which are initially displayed with a high level of con- 
sciousness become, after some time and repetition, auto- 
matic or are accompanied by a low level of consciousness. 
Perhaps this would provide a partial basis for explaining 
why some learning, especially of the affective behaviors, 
is so difficult. Perhaps it will also help to explain the 
extraordinary retention of some learning — especially of 
the psychomotor skills. 


Is the taxonomy a useful tool? 


We have subjected this classification scheme to a series 
of checks, primarily of communicability and comprehensive- 
ness. A major check of communicability was to determine 
whether a number of workers couldagree in their classifi- 
cation of specific educational objectives and test materials. 
Members of the taxonomy group discussed the classifica- 
tion of particular objectives in certain categories, and many 
ambiguities and inconsistencies were pointed out which we 
have attempted to remedy. Perhaps the most complete test 
of the classifications and their definitions has been the at- 
tempt of members of the group to classify a large number 
oftest items. One of the major problems in the classifi- 
cation of test items which this study revealed is that it is 
necessary in all cases to know or assume the nature of the 
Mahima cms i 

Bloom, B. S., and Broder, Lois, Problem-solving 
processes of college students (A Supplementary Educa- 
tional Monograph), Chicago: University of Chicago Press, 
Summer, 1950. 
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examinees! prior educational experiences. Thus, a test 
problem could require a very complex type of problem- 
solving behavior if it is a new situation, while it may re- 
quire little more than a simple kind of recall if the indi- 
vidual has had previous learning experiences in which this 
very problem was analyzed and discussed. This suggests 
that, in general, test material can be satisfactorily classi- 
fied by means of thetaxonomy only when the context in which 
the test problems were used is known or assumed. 


Comprehensiveness, of course, is never finally deter- 
mined. We have repeatedly taken lists of objectives found 
in courses of study and other educational literature and 
have attempted to classify them. As yet, in the cognitive 
domain we have encountered few statements of student be- 
haviors which could not be placed within the classification 
Scheme. However, although we have little difficulty in de- 
termining the major class within which a behavior falls, 
we still are not satisfied that there are enough clearly de- 
fined subclassifications to provide adequately for the great 
variety of objectives we have attempted to classify. 


In addition to comprehensiveness and communicability, 
the taxonomy should satisfy two other criteria if it is to be 
regarded as a useful and effective tool. First, it should 
stimulate thought about educational problems. If the tax- 
onomy is to prove a useful tool for educational research 
workers, it must aid them in formulating hypotheses about 
the learning process and changes in students. If it is to be 
useful for teachers and testers, it should provide a basis 
for suggestions as to methods for developing curricula, 
instructionaltechniques, andtestingtechniques. Asa highly 
organized and presumably comprehensive plan for classi- 
fying educational behaviors, it should form the basis for 
easily determining the availability of relevant evaluation 
instruments, techniques, and methods so that each worker 
can determine their appropriateness for his own work. 
Properly used, a taxonomy should provide a very suggestive 
Source of ideas and materials for each worker and should 
result in many economies in effort. 
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The early drafts of the taxonomy have already been ex- 
tensively used. Some of the examiners have found it useful 
as an aid in helping the faculty formulate objectives more 
precisely and in seeing a possible range of educational ob- 
jectives. The major categories of the taxonomy have been 
used in several institutions as a basis for classifying test 
material. The parallelism of objectives in different subject- 
matter fields is highlighted by this procedure, thus suggest- 
ing points of possible integration. Further, the transfer- 
ability of testing techniques from one subject field to another 
becomes clear. In at least one institution, diagnostic re- 
ports of test results to students are made in relation to the 
taxonomy. In this same institution, reports to the faculty 
onthe relationof the test results to the objectives andlearn- 
ing experiences are analyzed in terms of the taxonomy. 


Stimulation of thought on educational problems may 
also occur through the use of the taxonomy in organizing 
some of the literature on educational research. Usedin 
this way, it gives a relatively fresh view to some of this 
research and reveals many problems which have been largely 
ignored by educational psychologists, curriculum workers, 
and testers. Some of the studies on the relationship between 
measures of scholastic aptitude or intelligence and the evi- 
dence on the development of particular classes of behaviors 
have been brought together. This has revealed rather 
strikingly the relatively low relationship between tests of 
some of the more complex cognitive abilities and skills and 
measures of intelligence. Thus, the view that measures of 
the higher mental processes are Synonymous with measures 
of scholastic aptitude does not seem to be well-founded. 
This view has frequently been used to support the conten- 
tion that, since intelligence is presumed to be constant, 
little can be done to develop some of the higher mental pro- 
cesses through educative experiences. 


3Furst, Edward J., "Relationship between tests of 
intelligence and tests of critical thinking and knowledge, " 
Journal of Educational Research, Vol. 43, No. 8, April 
1950, pp. 614-25. 
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Available evidence has also been assembled on the 
interrelations among educational objectives. 4,5 These 
data give considerable support to the generalization that 
the relationships among measures of different objectives 
are determined by the nature of the learning experiences 
which the students have had. Thus, it seems possible un- 
der one curriculum to integrate various behaviors in such 
a way that very high correlations are obtained among the 
measures of the different objectives while under another 
curricular plan the correlations among the measures of 
the different objectives do not depart very much from 
chance. This has been a long-neglected area in curricu- 
lar planning and educational research. 


We have also attempted to organize some of the litera- 
ture on the growth, retention, and transfer of the different 
types of educational outcomes or behaviors. Here we find 
very little relevant research.” For the most part, research 
on problems in retention, growth, and transfer has not 
been very specific with respect to the particular behavior 
involved. Thus, we are usually not able to determine from 
this research whether one kind of behavior is retained for 
a longer period oftime than another or which kinds of edu- 
cative experiences are most efficient in producing a par- 
ticular kind of behavior. Many claims have been made for 
different educational procedures, particularly in relation 
to permanence of learning; but seldom have these been but- 
tressed by research findings. 


Altogether, the taxonomy is suggestive in pointing to 
a large number of problems in the field of education and 
testing. If the taxonomy could do nothing more than this , 
it would be useful. Although there are dangers in devising 


4 Furst, Edward J., "Effect of the organization of learn- 
ing experiences upon the organization of learning outcomes," 
Journal of Experimental Education, XVII (March 1954), 
pp. 215-28. 

5 Dressel, Paul L., and Mayhew, Lewis B., General 
Education: Explorations in Evaluation, Washington, D. C.: 
American Council on Education, 1954, pp. 249-53. 

Several of the more relevant references are listed 
in the footnotes on page 42. 
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a classification scheme which might tend to rigidify our 
thinking about education, the relatively chaotic nature of 
our field at present and the great emphasis on persuasive 
skills rather than on research findings for claims in the 
field of education justify some procedure such as this for 
ordering the phenomena with which we deal. 


A final criterion is that the taxonomy must be accepted 
and used by the workers in the field if it is to be regarded 
as a useful and effective tool. Whether or not it meets this 
criterion can be determined only after a sufficient amount 
of time has elapsed. We have attempted to secure the par- 
ticipation of a large number of achievement testers and 
evaluation specialists in the actual development and criti- 
cism of the classification scheme. The bulk of the com- 
ments from administrators, teachers, curriculum special- 
ists, and educational research workers on the preliminary 
edition of the taxonomy indicate that there is a real need 
for this kind of device. We do not regard it as perfect or 
as completed. We expect to continue to work on the de- 
velopment of the other domains and to revise this Handbook 
as experience dictates the need for improvement. We soli- 
cit your help in its further development by asking that you 
send us the suggestions which occur to you as you attempt 
to understand it and as you develop a body of experience 
through its use. 


CHAPTER 2 


EDUCATIONAL OBJECTIVES AND 


CURRICULUM DEVELOPMENT 


We have had some question about the relevance of this 
section in a handbook devoted to the details of a classifica- 
tion system. We have finally included it because we be- 
lieve the classification and evaluation of educational objec- 
tives must be considered as a part of the total process of 
curriculum development, Some of these considerations help 
to clarify the distinctions made in the taxonomy. It is 
hoped that many teachers will find this chapter useful as a 
summary of some of the arguments for inclusion ofa great- 
er range of educational objectives than is typical at the 
secondary school or college level. 


Problems of developing curriculum and instruction are 
uepaNy considered in relation to four major types of ques- 
tions. 


1. What educational purposes or objectives should 
the school or course seek to attain? 

2. What learning experiences can be provided that 
are likely to bring about the attainment of these 
purposes ? 

3. How can these learning experiences be effective- 
ly organized to help provide continuity and se- 
quence for the learner and to help him in inte- 
grating what might otherwise appear as isolated 
learning experiences ? 

4. How can the effectiveness of learning experi- 
ences be evaluated by the use of tests and other 
systematic evidence-gathering procedures ? 


1 The content of this section has been largely drawn 
from Ralph W. Tyler, "Achievement Testing and Curricu- 
lum Construction," Trends in Student Personnel Work, 


E. G. Williamson, Ed., Minneapolis, Minn.: University 
of Minnesota Press, 1949, pp. 391-407. 
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We are here concerned primarily with the first of these 
questions: the formulation and classification of education- 
al objectives. 


By educational objectives, we mean explicit formula- 
tions of the ways in which students are expected tobe 
changed by the educative process. That is, the ways in 
which they willchange in their thinking, their feelings, and 
their actions. There are many possible changes that can 
take place in students as a result of learning experiences, 
but since the time and resources of the school are limited 
only a few of the possibilities can be realized. It isim- 
portant that the major objectives of the school or unit of 
instruction be clearly identified if time and effort are not 
to be wasted on less important things and if the work of the 
School is to be guided by some plan. 


The formulation of educational objectives is a matter 
of conscious choice on the part of the teaching staff, based 
on previous experience and aided by consideration of sev- 
eral kinds of data. The final selection and ordering of the 
objectives become a matter of making use of the learning 
theory and philosophy of education which the faculty ac- 
cepts. 


One type of source commonly used in thinking about 
objectives is the information available about the students. 
What is their present level of development? What are their 
needs? Whatare their interests? Another source for ob- 
jectives is available from investigations of the conditions 
and problems of contemporary life which make demands on 
young people and adults and which provide opportunities 
for them. What are the activities that individuals are ex^ 
pected to perform? What are the problems they are likely 
to encounter? Whatare the opportunities they are likely to 
have for service and self-realization? 


Another source of suggestions for objectives comes 
from the nature of the subject matter and the deliberations 
of subject-matter specialists on the contributions their 
subject is able to make to the education of the individual. 
What is the conception of the subject field? What are the 
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types of learning which canarise froma study of that sub- 
ject matter? What are the contributions that the subject 
can make in relation to other subjects? 


It is likely that a consideration of these three sources 
will result ina suggested list of objectives which require 
more time and effort than the school has at its disposal. 
The problem of selecting among possible objectives as well 
as the determination of relative emphasis to be given to 
various objectives requires the use of some guiding con- 
ceptions. The philosophy of education of the school serves 
as one guide, since the objectives to be finally included 
Should be related to the school's view of the "good life for 
the individualin the good society." What are the important 
values? What is the proper relation between man and so- 
ciety? What are the proper relations between man and 
man? 


Finally, educational objectives must be related to a 
psychology of learning. The faculty must distinguish goals 
that are feasible from goals that are unlikely to be at- 
tained in the time available, under the conditions which are 
possible, and with the group of students to be involved. 
The use of a psychology of learning enables the faculty to 
determine the appropriate placement of objectives in the 
learning sequence, helps them discover the learning condi- 
tions under which it is possible to attain an objective, and 
provides a way of determining the appropriate interrelation- 
Ships among the objectives. 


It should be clear from the foregoing that objectives 
are not only the goals toward which the curriculum is 
Shaped and toward which instruction is guided, but they 
are also the goals that provide the detailed specification 
for the construction and use of evaluative techniques. Sev- 
eral of the sources which may be of value to the reader are 
listed in the footnotes. ^: 9: $, 9» 


2 Dressel, Paul L., "Evaluation Procedures for Gen- 
eral Education Objectives," Educational Record, April 1950, 
pp. 97-122. 

3 Lindquist, E. F., (Editor), Educational Measure- 
ment, Washington, D. C.: American Council on Education, 
1951, chap. 5. 
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A test of the achievement of students is atest of the extent to 
which the students have attained these educational objec- 
tives. An achievement test is an adequate and valid test if 
it provides evidence of the extent to which students are at- 
taining each of the major objectives of the unit of instruc- 
tion. 


The cognitive objectives derived from a process like 
that described in the foregoing paragraphs may, for dis- 
cussion purposes, be divided into two parts. One would be 
the simple behavior of remembering or recalling knowledge 
and the other, the more complex behaviors of the abilities 
and skills. The following section discusses these two divi- 
sions in turn, considering their nature, their appearance 
in the taxonomy, and their place in the curriculum. 


Knowledge as a taxonomy category 


Probably the most common educational objective in 
American education is the acquisition of knowledge or in- 
formation. That is, it is desired thatas the result of com- 
pleting an educational unit, the student willbe changed with 
respect to the amount and kind of knowledge he possesses. 
Frequently knowledge is the primary, sometimes almost 
the sole kind of, educational objective in a curriculum. In 
almost every course it is an important or basic one. By 
knowledge, we mean that the student can give evidence that 
he remembers, eitherby recalling or by recognizing, some 
idea or phenomenon with which he has had experience in 
the educational process. For our taxonomy purposes, we 
are defining knowledge as little more thanthe remembering 


4 Thomas, R. Murray, Judging Student Progress, New 
York: Longmans, Green & Co., 1954, chap. 1. 

5 Remmers, H. H., and Gage, N. L., Educational 
Measurement and Evaluation, Revised Edition, New York: 
Harper & Bros., 1955, chap. 1. 
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Tyler, Ralph W., and Smith, Eugene, Appraising 
and Recording Student Progress, Vol. III, New York: 
Harper & Bros., 1942, chap. 1. 
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of the idea or phenomenon ina form very close to that in 
which it was originally encountered. 


This type of objective emphasizes most the psycho- 
logical processes of remembering. Knowledge may also 
involve the more complex processes of relating and judg- 
ing, since it is almost impossible to present an individual 
with a knowledge problem which includes exactly the same 
stimuli, signals, or cues as were present in the original 
learning situation. Thus, any test situation involving knowl- 
edge requires some organization and reorganization of the 
problem to furnish the appropriate signals and cues linking 
it to the knowledge the individual possesses. It may be 
helpfulin this case to think of knowledge as something filed 
or stored in the mind. The task for the individual in 
each knowledge test situation is to find the appropriate 
signals and cues in the problem which will most effective- 
ly bring out whatever knowledge is filed or stored. For 
instance, almost everyone has had the experience of being 
unable to answer a question involving recall when the ques- 
tion is stated in one form, and then having little difficulty 
in remembering the necessary information when the ques- 
tion is restated in another form. This is well illustrated 
by John Dewey's story in which he asked a class, "What 
would you find if you dug a hole in the earth?" Getting no 
response, he repeated the question; again he obtained no- 
thing but silence. The teacher chided Dr. Dewey, "You're 
asking the wrong question." Turning to the class, she 
asked, "What is the state of the center of the earth?" The 
class replied in unison, "Igneous fusion. H 


John Dewey's story also illustrates the rote recall na- 
ture of some knowledge learning. The emphasis on knowl- 
edge as involving little more than remembering or recall 
distinguishes it from those conceptions of knowledge which 
involve "understanding," "insight, " or which are phrased 
as "really know," or "true knowledge." In these latter con- 
ceptions it is implicitly assumed that knowledge is of little 
value if it cannot be utilized in new situations or in a form 
very different from that in which it was originally encoun- 
tered, The denotations of these latter concepts would usu- 
ally be close to what have been defined as "abilities and 
Skills" in the taxonomy. 
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Whether or not one accepts this latter position, it is 
sufficient to note that knowledge by itself is one of the most 
common educational objectives. The most cursory read - 
ing of the standardized tests available or of teacher -made 
tests would indicate that tremendous emphasis is given in 
our schools to this kind of remembering or recall. A com- 
prehensive taxonomy of educational objectives must, in 
our opinion, include all the educational objectives repre- 
sented in American education without making judgments 
about their value, meaningfulness, or appropriateness. 
Knowledge, therefore, is one of our taxonomy categories. 


The knowledge category in particular and, as noted 
earlier, the classifications of the taxonomy in general 
range from the simple to the more complex behaviors and 
from the concrete or tangible to the abstract or intangible. 
By simple we mean elemental, isolable bits of phenomena 
or information, e.g., "the capital of Illinois is Springfield," 
or "Arkansas contains much bauxite." Thus, our base sub- 
classification is titled "knowledge of specifics." At the 
upper end of the knowledge category the subclassifications 
refer to more complex phenomena. Thus, remembering & 
theory is a more complex task than remembering à specific 
such as the capital of a state. Knowledge of the theory of 
evolution, for instance, would be very complex. Accord- 
ingly, the subclassification at the complex end of the knowl 
edge category is titled the "knowledge of theories and 
structures." 


The knowledge categories may also be viewed as run- 
ning from concrete to abstract. Thus, in general, knowl- 
edge of specifics will refer to concrete, tangible phenom- 
ena: "Insects have six legs;" "Most glass is brittle." But 
the more complex categories, as, for example, the name 
"knowledge of theories and structures" implies, tend to 
deal with abstract phenomena. 


It might sometimes be useful for taxonomy purposes 
to distinguish knowledge with regard to the different speci- 
alties, fields of knowledge, or subdivisions of work in our 
schools. Thus, it would be possible to dis tinguish knowledge 
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about the socialsciences from knowledge about the physical 
sciences, and knowledge of physics from knowledge of chem- 
istry, etc. Likewise, knowledge about man could be dis- 
tinguished from knowledge about physicalobjects, etc. The 
taxonomy as developed here should be applicable to any of 
the subdivisions of knowledge or educational units in which 
school curricula are divided, but no attempt will be made 
to make all the possible applications or subdivisions in 
this Handbook. The reader may wish to develop such further 
classifications as are necessary for his work, using the tax- 
onomy as a basis. 


What is knowable 


One of the major problems with regard to knowledge is 
determining what is knowable, for there are different ways 
in which something canbe said to be known. Adding to this 
problem is the fact that different criteria of accuracy and 
authenticity are applied to knowledge in different areas, at 
least the knowledge tobe learned in school. To a large ex- 
tent knowledge, as taught in American schools, depends 
upon some externalauthority; some expert or group of ex- 
perts is the arbiter of knowledge. Some information is the 
result of little more than convention and consensus. That 
is, a group of workers or experts in the field has come to 
some agreement on the ways in which particular terms 
will be defined, on the particular referents for selected 
symbols, or the most effective or practical ways in which 
to organize a field or attack problems init. For instance, 
lexicographers appear to make many arbitrary decisions 
in preparing a dictionary. The symbol system for punctu- 
ation is solely a matter of convention. Memorizing the con- 
jugation of verbs and the declension of nouns is accepted 
as the proper approach tolearning some foreignlanguages. 
Other information is known as the result of logical tests of 
consistency either by definition or by some logic of rela- 
tionship. Certain kinds of geometry, mathematical propo- 
sitions, and mathematical models are examples. Finally, 
some knowledge or information is known as the result of 
some historical, experiential, or pragmatic test. Thus, 
historical information is known as the result of a number 
of observations which are in agreement or which satisfy 
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particular historical tests of their authenticity. Scientific 
information is knownas a result of some observation, experi - 
ment, or test which meets the canons of scientific method- 


ology. 


It should also be noted that the validity, accuracy, and 
meaningfulness of information are relative in many ways 
and always are related to a particular period oftime. Thus, 
what is known in 1955 was not known in the same way in a 
previous era and will presumably undergo some changes in 
the future. Compare the way we pictured the atom twenty 
years ago with today's view of it. 


There is also a geographical and cultural aspect to 
knowledge in the sense that what is known to one group is 
not necessarily known to another group, class, or culture. 
It must be clear from all this, that knowledge is always 
partial and relative rather than inclusive and fixed. 


Justification for the development of knowledge 


Knowledge or information may be justified as an im- 
portant objective or outcome of learning in many Ways. 
Perhaps the most common justification is that with increase 
in knowledge or information there is a development of one's 
acquaintance with reality. Such reality may represent what 
is known by convention or definition, what are known as the 
findings or outcome of inquiry in the various fields, what 
are known as the more fruitful ways of attacking problems 
in the field, or what are known as the more useful ways 
of organizing a field. It is assumed that as the number 
of things known by an individual increases, his acquaint- 
ance with the world in which he lives increases. But, a8 
has been pointed out before, we recognize the point of view 
that truth and knowledge are only relative and that there 
are no hard and fast truths which exist for all time and 
all places. Nonetheless, most educators hold it desir- 
able that the learner increase his knowledge of what is 
currently known or accepted by the experts or specialists 
in a field, whether or not such knowledge, in a philosophi- 
cal sense, corresponds to "reality." 
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The selection of knowledge as an educational objective 
usually assumes some Stability inthe world, in the culture, 
or in the subject field. If the knowledge learned at one 
time is not regarded as very useful or accurate at another 
time, there would be little point in the student learning it. 
It is likely that the stability of knowledge varies consider- 
ably with the field or problem under consideration. Some 
fields or topics are undergoing such rapid transition that 
what is known at one time is not accepted or is altered 
shortly thereafter. Under such conditions the acquisition 
of knowledge could not be justified for its own sake but would 
have to be justified in relation to the other educational ob- 
jectives, a position which is discussed next. 


Another justification for the teaching of knowledge is 
that it is quite frequently regarded as basic to all the other 
ends or purposes of education. Problem solving or think- 
ing cannot be carried on in a vacuum, but must be based 
upon knowledge of some of the "realities." The intellec- 
tual abilities represented in the taxonomy assume knowl- 
edge as a prerequisite. Knowledge becomes either the 
material with which the problem solving deals or it be- 
comes the test of the adequacy and accuracy of the problem 
Solving. Thus in fields undergoing rapidtransition, knowl- 
edge may be taught, not so much with the expectation that 
it will prove eternally "true," but as a basis for learning 
the methodology of the field and as a basis for attacking the 
problems therein. Even the manipulative and motor skills 
assume some knowledge about the materials, methods, or 
tools that are used. Further, in another sense, all of the 
affective classifications make use of or are based upon 
knowledge. Thus, itis generally held that interests are 
developed as the result of an increase in information; like- 
wise, attitudes and appreciations are regarded as having 
Some base in knowledge or information. Even the objec- 
tives involving personal adjustment are quite frequently 
based upon the notion that a person must have some knowl- 
edge about himself before he can proceed to resolve his 
conflicts, anxieties, or other individual difficulties. It is 
clear that justification of knowledge for all these uses will 
usually involve knowledge in relation to other objectives, 
rather than knowledge for its own sake. 
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Still another justification for the development of knowl- 
edge as an objective of education arises from the status of 
knowledge in our own culture. Many workers assume a 
positive relationship between increase in knowledge and 
increase in maturity. In fact, quite frequently the increas- 
ing maturity of individuals or groups is judged in terms of 
their increasing knowledge about themselves or about the 
world in which they live. Knowledge is also frequently re- 
garded as an important criterion of brightness or intelli- 
gence. This is reflected in intelligence testing where 
vocabulary or knowledge questions predominate and are 
regarded as signs of intelligence. In many schools, knowl- 
edge is regarded as the primary index of the level of edu- 
cation an individual has attained. This is indicated by the 
content of our standardized achievement test. The layman 
frequently regards knowledge and education as being syn- 
onymous, The great emphasis on radio quiz programs and 
tests of either historical or contemporary information which 
appear in newspapers and magazines further reflects the 
status of knowledge in our culture. There is little doubt 
that our culture places tremendous weight on knowledge or 
information as animportant characteristic of the individual. 


Many teachers and educators prize knowledge to some 
extent because of the simplicity with which it can be taught 
or learned. Mass methods, such as lectures, audio-visual 
methods, printed material,and the like, can be readily used 
for the acquisition of information. Quite frequently we tend 
to think of knowledge as something which is learned as the 
result of simply presenting it to the learner in one form of 
communication or another. Clearly related to this is the 
ease with which it is possible to gauge the extent to which 
the student has acquired knowledge. Practically all teach- 
ers have considerable confidence in their ability to build 
tests of knowledge. Because of the simplicity of teaching 
and evaluating knowledge, it is frequently emphasized as 
an educational objective out of all proportion to its useful- 
ness or its relevance for the development of the individual. 
In effect, the teacher and school tend to look where the light 
is brightest and where it is least difficult to develop the 
individual. 
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Requiring that a student learn certain knowledge as- 
sumes a prediction that the student is likely to be able to 
make some use of the knowledge inthe future. Thus, 
knowledge about phenomena relevant to the specialization 
of the engineer is maximally useful if the student is to be- 
come an engineer. Requiring the student to learn about en- 
gineering phenomena means that we can predict that he will 
be an engineer or that the knowledge will transfer to other 
areas where he is likely to be able to use it. Knowledge 
required of students priorto their making a firm vocational 
choice will need to have more general relevance and wide- 
spread usefulness than after a firm choice is made.  Ex- 
tensive knowledge requirements in rapidly changing special- 
ized fields need to be checked against the best possible 
prediction of what knowledge will be of continuing use and 
what knowledge is necessary for a grasp of the current 
known field. The teacher and the curriculum specialist 
must take all these factors intoaccount in determining what 
knowledge to select. 


Undoubtedly the greatest predictability arises within 
the school itself where it may be known that the knowledge 
learned in one class will be used in one way or another in 
a subsequent course. Conversely, there is least predict- 
ability in the attempt to relate what is learned in the class- 
room to what the student mayneed as acitizenor specialist. 


Our general understanding of learning theory would 
seem to indicate that knowledge which is organized and re- 
lated is better learned and retained than knowledge which 
is specific and isolated. By this we mean that learning a 
large number of isolated specifics is quite difficult simply 
because of the multiplicity of items toberemembered. Fur- 
ther, they cannot be retained very well if they are kept in 
Such isolation. Thus one hundred nonsense syllables would 
be more difficult to learn than an equal number of syllables 
in a meaningful poem. Specifics can be learned in relation 
to a generalabstraction, and as a result can be remem- 
bered or retained best in this relationship. When learning 
takes place in this way, it is possible for an individual who 
remembers the generalization to proceed relatively easily 
to some ofthe specifics subsumed under that generalization, 
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On the other hand, generalizations or abstractions are rela- 
tively difficult to learn unless they are related to appropri- 
ate concrete phenomena. A generalization isolated from 
the phenomena it covers is very difficult to learn and very 
hard to retain. Asa matter of fact, some definitions of 
intelligence" regard the abstractness of the ideas an indi- 
vidual can understand as a good index of the level of intel- 
ligence. 


Curricular decisions to be made about knowledge objectives 


Four decisions to be made with respect to the nature 
of the knowledge objectives included in the curriculum should 
be noted. These relate to How much knowledge should be 
required learning?";" How precisely need the student learn 
the required knowledge? "'; "How is knowledge best organized 
for learning?': and "How meaningful need required knowl- 
edge-learning be to the student?" 


Decisions withrespect to "How much knowledge should 
be required learning?" must strike a balance between at- 
tempts to include all the knowledge the individual might con- 
ceivably acquire in a particular subject and only that knowl- 
edge which is most basic to the subject. Rarely does the 
educator lean toward the latter of these two alternatives. 
Some educators frequently assume that the knowledge which 
the expert or specialist needs to possess about a field or 
topic and the knowledge which the beginning student may 
reasonably be expected to learn are identical. Such an as- 
sumption tends to overestimate the student's ability to learn 
and retain information. These educators must decide 
whether the student's time and effort are best used in be- 
coming acquainted with the major knowledge in the field or 
in thoroughly mastering that knowledge which is basic to 
further learning in the field. For instance, in the field of 
mathematics it would be possible for the student to become 
aware of the existence and nature of the major mathemati- 
cal techniques or to concentrate on learning the fundamen- 
tals which would permit him to later pick up these tech- 
niques on his own. 


— Trans Wat SAaaOUnG j i 
See Stoddard, George D., The Meaning of Intelli- 
gence, New York: The Macmillan Co., 1944. 
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A second decision, the degree of precision to be re- 
quired of the student, is not unrelated to the first. Thus, 
requiring the student to "become aware of the existence and 
nature of the major mathematical techniques" would pre- 
sumably permit the student some latitude in the precision 
of his recall of the details of the techniques. On the other 
hand, to "thoroughly master that mathematical knowledge 
which is basic to further learning" implies a rather high 
standard of precision in the learning of this material. This 
decision about the precision to be required of the student 
exists at alllevels of knowledge. Thus, even in the sim- 
plest type of objective such as knowledge of terminology, 
it is quite conceivable for a student to learn definitions of 
terms at many different levels of accuracy and precision. 
Usually greater precision is required at later stages of 
training. Thus, the student is introduced to an item of 
knowledge at a general but accurate level, gradually mak- 
ing finer and finer distinctions as he uses the item until 
he has reached the more detailed and precise level of the 
expert. 


A third decision relates to the best organization of 
knowledge to facilitate learning. As previously noted, the 
cases of the specialist andthe student are not identical. The 
organization the specialist finds most useful is not neces- 
Sarily the organization that provides the easiest learning 
path for the student. The decision to be made is whether 
to use anorganization externally imposed by some authority 
or expert as compared with an organization that fits the in- 
ternal state of the learner at his particular stage of devel- 
opment. 


A fourth decision with respect to the nature of knowl- 
edge objectives in the curriculum relates to the immediate 
as opposed to the future need of the student for this infor- 
mation. A student can memorize a body of information 
whether or not he finds immediate use for it or whether it 
meets any of his present needs. This is particularly true 
once the student becomes habituated to this kind of learning, 
as many of our students have. Many schools orient their 
students in this direction by the use of grades, examina- 
tions, and competition. It is likely that if the teacher 
believes the learning of knowledge is important or can 
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communicate the importance of it to the students, there will 
be little difficulty in obtaining learning of even the most 
artificial and esoteric kinds of information. 


The nature of abilities and skills 

Although information or knowledge is recognized as an 
important outcome of education, very few teachers would 
be satisfied to regard this as the primary or the sole out- 
come of instruction. What is needed is some evidence that 
the students can do something with their knowledge, that is, 
that they can apply the information to new situations and 
problems. is also expected that students will acquire 
generalized techniques for dealing with new problems and 
new materials. Thus, it is expected that when the student 
encounters anew problem or situation, he will select an ap- 
propriate technique for attacking it and will bring to bear 
the necessary information, both facts and principles. This 
has been labeled "critical thinking" by some, "reflective 
thinking" by Dewey and others, and "problem solving" by 
still others, In the taxonomy we have used the term "in- 
tellectual abilities and skills." The most general opera- 
tional definition of these abilities and skills is that the 
individual can find appropriate information and techniques 
in his previous experience to bring to bear on new problems 
andsituations. This requires some analysis or understand- 
ing ofthe new situation; it requires a background of knowl- 
edge or methods which can be readily utilized; and it also 
requires some facility in discerning the appropriate rela- 
tions between previous experience and the new situation. 


Arts or skills + knowledge = abilities 


Sometimes in educational achievement testing We wish 
to distinguish between what we might call "intellectual 
abilities" and "intellectual arts and skills." "Arts and 
skills" refer to modes of operation and generalized tech- 
niques for dealing with problems. In testing for arts and 
skills, the problems and materials are of such a nature 
that little or no specialized and technical information is 
required. Whatever information is required is assumed to 
be part of the general fund of knowledge of the group being 


39 


tested. The emphasis in testing is on the examinee's com- 
petence in using a generalized method of operating or deal- 
ing with a new problem situation. The arts and skills em- 
phasize the mental processes of organizing and reorganizing 
material to achieve a particular purpose. 


The intellectual abilities, on the other hand, refer 
to situations in which the individual is expected to bring 
specific technical information to bear ona new problem. 
They represent combinations of knowledge and intellectual 
arts and skills. In solving problems requiring intellectual 
abilities, the student is expected to organize or reorganize 
a problem, to recognize what material is appropriate, to 
remember such material, and to make use of it inthe prob- 
lem situation, In the case both of abilities and of skills, 
the problems are intended to be new and unfamiliar to the 
student. 


Although this distinction between intellectual abili- 
ties and intellectual skills may be made in achievement test- 
ing, it is rather difficult to classify educational objectives 
and test items as abilities or skills without a full knowledge 
of the prior experience of the students. It is for this rea- 
son that the distinction has been omitted in the taxonomy 
and is only briefly mentioned here. 


Justification for the development of intellectualabilities and 
skills 


Justification for the development of intellectual abili- 
ties and skills can readily be derived from a consideration 
of the nature of the society and culture in which we live, the 
knowledge thatis available to us, and the kind of citizen the 
schools seek to develop. Further justification may be de- 
rived from what is known in educational psychology about 
the permanence of various kinds of learning and the extent 
to which various kinds of learning can be transferred to 
new situations. 


The development of problem-solving skills (intellec- 
tual abilities and skills) is not equally necessary in all 
societies and cultures. It is possible to imagine a society 
or culture which is relatively fixed. Such a society repre- 
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sents a closed system in which it is possible to predict in 
advance both the kinds of problems individuals will encounter 
and the solutions which are appropriate to those problems. 
Where such predictions can be made in advance, it is pos- 
sible to organize the educational experiences So as to give 
each individual the particular knowledge and the specific 
methods needed for solving the problems he will encounter. 
Probably the nearest one can come to such aclosed system 
in our culture is in some aspects of military life. For in- 
stance, if one is training an individual to be a radio techni- 
cian for military work, it is frequently possible to know in 
advance exactly what kind of radio circuits he will have to 
work with. Under these conditions it is possible to reduce 
the amount of training to only these particular radio cir- 
cuits and to teach the individual how to solve all the fore- 
seeable difficulties he willencounter in working with them. 
Such training can be quick and efficient, but it is highly 
restricted since it is applicable to only avery limited range 
of situations. 


Whatever the case in the past, it is very clear that 
in the middle of the 20th century we find ourselves in a 
rapidly changing and unpredictable culture. It seems almost 
impossible to foresee the particular ways in which it will 
change in the near future or the particular problems which 
will be paramount in five or ten years. Under these condi- 
tions, much emphasis must be placed in the schools on the 
development of generalized ways of attacking problems and 
on knowledge which can be applied toa wide range of new 
situations. That is, we have the task of preparing indivi- 
duals for problems that cannot be foreseen in advance, and 
about all that can be done under such conditions is to help 
the student acquire generalized intellectual abilities and 
skills which will serve him well in many new situations. 
This places faith in the intellectual virtues as providing 
some form of stability for the individual who must find or 
make some order in his world. 


However, even inthe relatively stable culture or S07 
ciety, we do have to recognize that all knowledge is partial 
and that each situation the individual encounters has some 
unique characteristics. Forced to act, the individual has 
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the task of taking what knowledge he has (which is only 
partially appropriate to a situation) and determining its 
relevance to the new situation. Since each situation is 
unique, the individual must be able to recognize which es- 
sential characteristics of the new situation are related to 
Situations he has already encountered; then he must apply 
the correct knowledge and method with appropriate modi- 
fications. Clearly it is impossible to givethe individual all 
the knowledge he will ever need for every new situation he 
willencounter. It is possible, however, to helphim acquire 
that knowledge which has been found most useful inthe past, 
and to help him develop those intellectual abilities and 
Skills which will enable him to adapt that knowledge to the 
new situations. 


The importance of the intellectual abilities and skills 
is further illustrated by our recognition of the individual's 
ability to independently attack his problems as a desirable 
sign of maturity. Individuals are expected, as they mature, 
to solve problems on their own and to make decisions wisely 
on the basis of their own thinking. Further, this independ- 
ent problem solving is regarded as one indication of the 
individual's adjustment. It is recognized that unless the 
individual can do his own problem solving he cannot main- 
lain his integrity as an independent personality. 


Closely allied to this concept of maturity and integ- 
rity is the concept of the individual as a member of a demo- 
cracy. Citizens are expected to make important and inde- 
pendent decisions about governmental problems and about 
their political future. It is clear that many of these deci- 
sions require problem solving of a very high order. It is 
impossible to tell an individual in advance how to vote or 
even the bases on which he should vote. These are matters 
he must decide repeatedly throughout his life whenever a 
major election takes place. But more than specific elec- 
tions and voting is the concept of individuals in a democracy 
as independent decision-makers who, in the last analysis, 
are responsible for the conduct of a democratic political 
System as well as a democratic way of life. 
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The above justifications for the development of intel- 
lectual abilities and skills reflect a number of value compo- 
nents in relation to the concept of the good life. The follow- 
ing two reasons have to do primarily with the efficiency of 
the learning process. 


As we have defined intellectual abilities and skills, 
they are more widely applicable than knowledge. If we are 
concerned with the problem of transfer of training, by defi- 
nition we would select intellectual abilities and skills as 
having greater transfer value. 


A second reason for the efficiency of intellectual abil- 
ities and skills in learning is their permanence. From 
psychological theory (e.g., reinforcement theory) it would 
seem reasonable to expect greater permanence of learning 
for those outcomes of education which can be generalized 
and applied in à number of different situations throughout 
the individual's formal educational experience than for those 
outcomes which are so specific that they are likely to be 
encountered only once or at the most a few times through- 
out the educational program. It would seem desirable to 
determine whether research evidence is in support of our 
logical and pedagogical distinctions. While only a few stu- 
dies in the literature deal with this problem, the findings 
are in general support of the foregoing. 8,9, 


Finally, the foregoing discussion has illustrated the 
importance of the abilities and skills for both the individual 
and his society, and it has noted the learning efficiency of 
the abilities and skills. But common observation would in- 
dicate that individuals in general tend to avoid real problem 
solving. When presented with problems, they usually apply 
a limited stock of techniques to them and are frequently 
satisfied if a partial solution is obtained. If the techniques 


8 Freud, H., and Cheronis, N. D., "Retention in the 
Physical Science Survey Course, " Journal of Chemical 
Education, 17 (1940), pp. 289-93. 

9 Frutchey, F. P., "Retention in High School Chem- 
istry," Journal of Higher Education, 8 (1937), PP- 217-18. 

10 Tyler, R. W., "Permanence of Learning, " in Con- 
structing Achievement Tests, Columbus: Ohio State Uni- 
versity, 1934. 
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do not work, there is a strong tendency either to reorder 
the problem completely (that is, to make it a new problem) 
or to escape from it entirely. Rarely do individuals stay 
with a difficult problem for any considerable length of time 
and try increasingly varied procedures for attacking it. 
Yet, we need more than ever to help students develop 
problem-solving methods which will yield more complete 
and adequate solutions ina wide range of problem situa- 
tions. It is to be hoped that the taxonomy's analysis of this 
area willfacilitate the exploration of new methods of teach- 
ing for high-level problem Solving and assist in evaluating 
these methods. 


CHAPTER 3 


THE PROBLEMS OF CLASSIFYING 
EDUCATIONAL OBJECTIVES 
AND TEST EXERCISES 


Three levels of definition in each taxonomy category 


The taxonomy Handbook in its present form defines a 
class or sub-class of educational objectives in three ways. 
The first and major type of definition is represented by a 
verbal description or definition of each class and sub-class. 
The exact phrasing of these definitions has been the subject 
of much debate among us and, while the present definitions 
are far from ideal, every effort has been made to describe 
the major aspects of each category as carefully as possible. 


A second type of definition is provided by the list of 
educational objectives which are included under each sub- 
class of the taxonomy. The objectives used here have been 
selected from the published literature on curriculum and 
testing as well as from unpublished materials available in 
the files of the examiners and curriculum specialists. In 
a number of cases, the objectives have been slightly modi- 
fied in order to more precisely express the student behav- 
ior intended. Most of the objectives listed in this Handbook 
have been selected from courses and programs at the gen- 
eral education and secondary education levels. While some 
attempt has been made to select objectives from different 
subject fields, it is likely that each subject is not equally 
well represented in these lists. Inclusion of an objective 
in this volume does not mean that we believe itis an im- 
portant objective or even that it is the best way of formu- 
lating such an objective. We do believe that the objectives 
finally included are representative of those found in the 
literature and that they are appropriately classified. 


The third type of definition attempts to make clear the 
behavior appropriate to each category by illustrations of 
the examination questions and problems which are regarde 
as appropriate. In a way, this represents the most detaile 
and precise definition of the sub-class since it indicates 
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the tasks the student is expected to perform and the speci- 
fic behavior he is expected to exhibit. The illustrative test 
exercises included in this Handbook have been selected 
from published examinations as well as from examinations 
available in the files of the cooperating examiners. While 
some effort has been made to draw these examples from 
the different subject fields and from secondary as well as 
college courses, it is likely that particular areas and 
particular levels are not as fully illustrated as desirable. 
The reader will note the high proportion of so called "ob- 
jective" or recognition forms of test questions, This does 
not reflect a bias against carefully devised essay or other 
types of test situations. We have made use of illustrations 
which were readily available and selected examples which 
most clearly illustrated the category. 


In order to help the reader get an over-all view of the 
taxonomy and to help him in its use, we have printed a 
condensed version of the taxonomy in the Appendix, Each 
of the classes of objectives is defined in greater detail in 
the appropriate section of this volume where it is accom- 
panied by a discussion of the particular objectives and test 
illustrations which are relevant. 


The classification of objectives 


To help the reader in making use of the taxonomy, this 
chapter is devoted to a discussion of the problems of clas- 
Sifying educational objectives and test exercises. A num- 
ber of illustrative objectives and test exercises are provided 
for the reader to classify for himself. He can then compare 
his classification with those made by the writers. The in- 
tent of this chapter is thus to bring the reader closer to the 
taxonomy and to convert it from an empty set of terms and 
definitions to one that the reader finds workable and appli- 
cable to his own situation. 


We begin by selecting three objectives € Volume I 
of Higher Education for American Democracy which ap- 
pear to be relevant to the cognitive domain of the taxonomy. 


lA Report of the President's Commission on Higher 
Education. Higher Education for American Democracy, 


Volume I, Establishing the Goals, U. S. Government 
Printing Office, Washington, December, 1947. 
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(A) to understand the ideas of others and to 
express one's own effectively (p. 52) 


(B) to acquire the knowledge (and attitudes) basic 
to a satisfying family life (p. 56) 


(C) to acquire and use the skills and habits involved 
in critical and constructive thinking (p. 57) 


All three of these would appear to represent desirable out- 
comes of learning. However, they are such broad objec- 
tives that the kinds of learning experiences which might be 
appropriate are far from clear. At this level of generality 
one would also have great difficulty in determining the types 
of evaluation evidence which could reveal whether or not 
students have actually developed the necessary competence. 
As they are stated, these broad objectives could only be 

classified under such broad categories as knowledge or 

intellectual abilities. Thus, objective A includes both un- 

derstanding ofideas and (the ability) to express ideas effec- 

tively. At this level of generality the objective could be 

included under each of the six major categories of this tax- 

onomy. Objective C quite clearly goes beyond the knowl- 

edge category, but it could quite properly be included under 

each of the remaining five categories of Comprehension, 

Application, Analysis, Synthesis, and Evaluation. Objec- 

tive B includes both knowledge and attitudes. However, if 

only the knowledge aspect of this objective is considered, 

it could quite properly be classified under category 1.00 

of this taxonomy—Knowledge. It is, however, impossible 

to determine which of the different subclasses of knowledge 

are appropriate. 


The user of the taxonomy will find that, all too frez 
quently, educational objectives are stated so broadly that 
little can be done with them for curricular or evaluation 
purposes until they have been more adequately defined. As 
broad outcomes they are extremely useful in suggesting 
general policy for a particular educational institution, for a 
group of institutions, or for a type of educational program. 
And, in fact, this level of generality is typical of college 
catalogs and the printed statements of aims of secondary 
schools. The majority of publications in which some educa- 
tional policy group or general curriculum group attempts to 
define or suggest the desired outcomes of education are 


couched in terms equally broad. When faculty groups first 
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begin to state their educational objectives they tend to make 
use of aims stated as generally as those found in the report 
of the President's Commission on Higher Education, Al- 
though the taxonomy is not too useful in classifying such 
broadly stated outcomes of learning, it is useful in helping 
to determine the level of specificity at which. statements of 
objectives can be utilized in planning learning experiences 
and suggesting types of evaluation evidence which might be 
appropriate. The taxonomy is also useful as a means of 
raising questions which can have the effect of more clearly 
defining such generalized outcomes. All this is to say that 
the reader should not be overly frustrated at encountering 
and attempting to deal with educational objectives which are 
so broad that little can be done with them as far as classi- 
fication is concerned, He should also recognize that at this 
level of generality little can be done with them as far as 
specific problems of curriculum and evaluation are concern- 
ed, Nevertheless, it is repeated that such broad aims are 
useful in pointing up general policy and directions for cur- 
riculum development. 


A somewhat more clearly defined set of educational 
objectives for purposes of illustration is offered by the 
report "A Design for General Education." This report, 
like the President's Commission report on Higher Educa- 
tion, has a list of broad outcomes of general education. 
Three of them which are parallel to those reported on 
page 46 are: 


(D) to communicate through his own language in writing 
and speaking at the level of expression adequate to 
the needs of educated people (p. 14) 


(E) to think through the problems apd to gain the basic 
orientation that will better enable him to make a 
satisfactory family and marital adjustment (p. 14) 


(F) to act in the light of an understanding of the natural 
phenomena in his environment in its implications for 


2 American Council on Education Studies. MA: Design 
for General Education," American Council on Education, 
Washington, June 1944, 


48 


human society and human welfare, to use scientific 
methods in the solution of his problems, and to em- 
ploy useful nonverbal methods of thought and com- 
munication (p. 14) 


These are obviously too broad to classify with any precision 
in the taxonomy. However, in addition to these broad out- 
comes, the Design includes over 200 objectives which are 
more clearly defined in terms of student behavior and sub- 
ject matter content, These more specific objectives are 
grouped under ten broad outcomes. The specific objec- 
tives can be classified with some precision under the appro- 
priate categories and sub-categories of the cognitive domain. 
Five of these are selected for purposes of discussion. 


(G) (Knowledge and understanding) of reliable 
sources of information on health (p. 31) 


Although the full intent of the word ‘understanding’ is not 
clear, the emphasis on knowing, and possibly remembering, 
places this objective rather clearly under the general head- 
ing of 1.00 Knowledge. Since the emphasis appears to be on 
the knowledge of reliable sources rather than on the ability 
to locate new sources or the ability to analyze the accuracy 
and reliability of sources, this objective is classifiable as 


1.12 Knowledge of specific facts. 


(H) To read significant writings with critical 
comprehension (p. 34) 


Although the full intent of the word "critical" is not 
clear, the emphasis on reading and comprehension suggests 
that this objective is appropriately classified under the major 
category, 2.00 Comprehension. Although a case could be 
made for including this objective under 2.10 Translation or 
2.30 Extrapolation, it is likely that the objective IN 
accurately classified as 2.20 Interpretation, since this # 
the sub-category of Comprehension which emphasizes the 
grasping of the meaning of a written work. 


(I) The ability to apply principles to new 
situations (p. 43) 


This objective is described in such a way a° to apply 


most directly to category 3.00 Application. 
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(J) The ability to recognize form and pattern in 
literary works as a means of understanding 
their meaning (p. 44) 


This objective apparently involves a competence in ana- 
lyzing the organization of a literary work to determine its 
formal and structural characteristics, This type of skill is 
included under the category 4.00 Analysis. Since it can be 
defined as involving an analysis of the structure and organi- 
zation of a communication, it is appropriately classified 


under 4.30 Analysis of organizational principles. 


(K) The ability to select and organize ideas and 
experiences with reference to socially de- 
sirable purposes of communication (p. 33) 


In this objective the emphasis appears to be on the put- 
ting together of elements and parts so as to form a whole, 
As such it would be an example of what we have termed 
5.00 Synthesis, It can further be defined as the first sub- 


category of synthesis, 5.10 Production of a unique commu- 


nication, since for the individual writer or speaker the em- 
phasis is on the communication, rather than on the other 
types of synthesis defined under this major category. 


(L) The ability to identify and appraise judgments 
and values that are involved in the choice of a 
course of action (p. 41) 


The identification of the judgments and values involved 
in the choice of a course of action suggests a type of com- 
prehension or analysis, However, the appraisal of the 
judgment and values represents a kind of evaluation, The 
rule we have adopted is to place the objective under the high- 
est type of classification (the most complex) which is appro- 
priate. Therefore, this objective would be classified as 
6.00 Evaluation. Since the evaluation of judgments and 
values must, if it is to be based on cognitive grounds, refer 
to some sort of external criteria, the appropriate classifica- 


tion of this objective is 6,20 Judgments in terms of external 


criteria. 


50 
Test yourself on the classification of objectives 


The reader may wish to try his hand at classifying other 
objectives under the categories of the condensed version of 
the taxonomy in the Appendix. For this purpose the follow- 
ing 10 objectives have been selected from "A Design for Gen- 
eral Education," The Key to the classification of each of 
these objectives will be found on page 59. 


1, (Knowledge) of community organizations and services 
for health maintenance and improvement (p. 31) 


2. (Knowledge) of acceptable usage in articulation, pro- 
nunciation, capitalization, grammar, and spelling as 
a means of effective presentation (p. 33) 


3. (Ability) to listen to important oral statements with 
concentration and judgment (p. 34) 


4, (Knowledge) of the criteria of normal and neurotic 
adjustment (p. 35) 


5, (Knowledge) of the trends in American society affect- 
ing the structure and functions of the family and the 
role of women and children in our society (p. 36) 


6, The ability to read graphs, diagrams, and blueprints 
(p. 43) 


7. (Knowledge) of the techniques and methods used by 
scientists in seeking to answer questions about the 
world, and of the proper functions of scientific theory 
and experiment (p. 42) 


8. The ability to recognize artistic quality in contempo" 
rary works of music and art (p. 45) 


9. The ability to formulate explicitly and systematically 
a pattern of values as a basis of individual and soc? 
action (p. 41) 


10. The ability to evaluate popular health beliefs criti- 
cally (p. 32) 
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The problems of classifying test exercises 


The task of classifying test exercises is somewhat more 
complicated than that of classifying educational objectives. 
Before the reader can classify a particular test exercise 
he must know, or at least make some assumptions about, 
the learning situations which have preceded the test, He 
must also actually attempt to solve the test problem and 
note the mental processes he utilizes. The reader should 
also take into consideration the possibility that the proces- 
Ses used in selecting the correct answer in a recognition 
form of question may be somewhat different from those used 
in considering the incorrect alternatives in the same ques- 
tion, For purposes of illustration we have selected a series 
of test exercises from the book, The Measurement of Under- 
standing. 3 


(I) As the number of mechanical inventions increases and 
society becomes more complex: (1) Each worker does more 
Specialized work. (2) Each person takes care directly of 
more of his needs. (3) People depend less on each other. 
(4) Each worker does a greater variety of work. (p. 88) 


It is assumed that the student has had learning experi- 
ences which stress specialization of function with increas- 
ing industrialization and complexity of the society. Although 
the particular formulation of the test item may be new, 
the concept of specialization is familiar. With this assump- 
tion, the item is clearly classified under 1.00 Knowledge. 
Since the emphasis is on a generalized concept rather than 
particular concrete facts, it is appropriate to further clas- 
sify it under the sub-category 1.31 Knowledge of principles 
and generalizations. à 


(II) From which could you obtain information concerning 
the location of the principal oil fields of the United States ? 
(1) Department of State (2) Department of Interior (3) De- 
partment of Education (4) Department of Agriculture (p. 91) 


JBrownel William A., Chairman, et al. The Meas- 
urement of Understanding, The Forty-fifth Yearbook of the 
National Society forthe Study of Education, Part I, Chicago: 
The University of Chicago Press, March 1946. 
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It is assumed that the student has learned about the 
functions of the different departments and that he has 
learned about the types of publications and kinds of informa- 
tion one might in general secure from each department. 
This would then be readily classified under 1, 00 Knowledge. 
Since what is asked for is a relatively detailed bit of infor- 
mation, it would be further classified as 1,12 Knowledge of 
specific facts. 


(II) The underlined statement at the end of the problem 
is assumed to be a correct answer. You are to explain the 
underlined conclusion by selecting statements from the list 
following the problem. (The student checks the explanations 4) 


If a person is planning to bathe in the sun, at what time of 
day is he most likely to receive a severe sunburn? He is 
most likely to receive a severe sunburn in the middle of 


the day (11 A.M. to 1 P.M.) because: 


We are slightly closer to the sun at noon than in the 
morning or afternoon. 

The noon sun will produce more "burn" than the 
morning or afternoon sun. 

When the sun's rays fall directly (straight down) on 4 
surface, more energy is received by that surface 
than when the rays fall obliquely on the surface. 

When the sun's rays fall directly (straight down) on a 
surface, less sunshine is reflected from the surface 
than when the sun's rays fall obliquely on that surface. 

When the sun is directly overhead the gun's rays pass 
through less absorbing atmosphere than when the sun 
is lower in the sky. 

Just as a bullet shot straight into a block of wood pene- 
trates farther into the wood, so will the direct ray® 
at noon penetrate more deeply into the skin. 

The air is usually warmer at noon than at other 
times of the day. 

The ultraviolet of the sunlight is mainly responsible 
for sunburn, (114) 


It is assumed that this is a new problem for the student 
and that the task is one of selecting the correct explanatory 
principle. Some of the alternatives offered are factually 
correct while others are incorrect, Some are relevant, 
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others are irrelevant, Some merely repeat the conclusion, 
while others state the generalizations or principles which 
have explanatory value. Selecting the appropriate explana- 
tory generalizations requires that the student be able to re- 
late the appropriate generalizations to the situation, This 
would then be classified as 3.00 Application. 


(IV) Statement of facts: 


Per Cent of Family Members 
Who Received No Medical 


Family Income Attention During the Year 
Under ($1200 shul, 61 hate 1 204 
$1200. to $3000. a), OPERE AO 
$3000 to $5000°.. . . . i 4798 
$5000 to $10,000 2 3. . $9 0.724 
Over $10 000% 4:121 sls 2) Sarin eats 


Conclusion: Members of families with small incomes are 
healthier than members with large incomes. 


The conclusion is not completely justified by the facts 
given, It may be justified, however, if an assumption is 
made; that is, if a factor not stated in the given facts is tak- 
en for granted. What is this factor? That is, what must be 
assumed in addition to the facts given in order that the con- 
clusion be true? (p. 127) 


If it is assumed that the data and the problem are essen- 
tially new to the student, it requires that the student be able 
to identify the assumption which must be made to support 
the conclusion in relation to the data. It is thus an example 
of 4,10 Analysis of elements. 


(V) A 6A class was studying the geography of Europe and 
the land of the Dutch people. Someone in the class said 
that the homes of the Dutch people who live in America are 
always neat and clean, The teacher asked this question, 
"What reasons can you give for thinking that they are al- 
ways neat and clean?" 
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Here are some of the reasons the children gave. Read 
them carefully and decide which are the best and which are 
the poorest. 


I heard someone say that they were neat and clean, 


I was in one Dutch home and it was clean, 
Our geography book said they were clean. 


I have been in many Dutch homes and all of them 
were neat and clean. 


ai 


I read in the story book that these houses were 
always neat and clean, (p. 93) 


Here the student is expected to judge the value of reasons 
in relation to a new question which is posed in the problem. 
It is clearly an example of 6.00 Evaluation, Since the em- 
phasis is on quality of evidence in relation to the sources 
and the comprehensiveness of the information it could appro- 
priately be placed under the sub-category of 6.20 Jud ments 
in terms of external criteria. 


Test yourself on the classification of test exercises 


The reader may now wish to try his hand at classifying 
additional test exercises. The following exercises have 
been selected from the book, Measurement of Understanding. 
The key to the classification of these exercises will be found 
on page 59. 


In the following problem, assume that the student has 
studied tariffs in some detail. 


1. Which has been a result of this country's policy of 
maintaining a high protective tariff? (1) Higher prices for 
domestic goods (2) lower prices for foreign goods (3) in- 
creased foreign trade (4) higher prices for farm products 
sold in foreign markets (p. 88) 
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For the purpose of checking the statements at the end of this 

problem, the data alone: 

(1) are sufficient to make the statement true. 

(2) are sufficient to indicate that the statement is probably 
true. 

(3) are not sufficient to indicate whether there is any degree 
of truth or falsity in the Statement. 

(4) are sufficient to indicate that the statement is probably 
false. 

(5) are sufficient to make the statement false. 


Mark each of the following statements with the number of 
one of the foregoing statements which indicates your inter- 
pretation of the data in the table. 


2. In 1935 less was spent for general government ex- 
penses than for highways. 
3. The highway expenditures of New York, Ohio, and 


Illinois together were at least twice as large in 
1930 as in 1910. 


4, In 1930 more than five times as much money was 
spent for highways as for health. 

5. sn 1929 at least 35 per cent of the total expenditures 
of the states was for education. 

6. The expenditures for each type of service shown in 


the table increased between 1910 and 1930. (p.94) 


Assume that the student has learned something about mete- 
orology, but that the particular relationships between the 
fact and the statements have not been studied in this form. 


7, Tell whether each of the statements following the fact is 
(A) a cause of the fact, (B) a result of the fact, or (C) not 
related to the fact. 


Fact: A flash of lightning occurs. 
Statements 


A roar of thunder can be heard. Nt 
Electricity passed between clouds and the earth. | —— 


It is dangerous to stand under a tree during a 
rainstorm. (p. 135) p 
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Some additional test exercises drawn from the files of the 
cooperating examiners are presented below. 


8. A brick can be pulled along a fairly smooth surface by 
means of a string; the string would break, however, if 
jerked sharply. Which of the following principles is 
most directly useful in explaining this fact? 


A- 
B- 


C- 
D- 
E- 


Force is equal to mass times acceleration, 
Friction exists between any two bodies in contact 
with each other. 

Conservation of momentum 

Conservation of energy 

None of these principles applies. 


"For what men say is that, if I am really just and am not 
also thought just, profit there is none, but the pain and loss 
on the other hand are unmistakable. But if, though unjust, 
I acquire the reputation of justice, a heavenly life is prom- 
ised to me. Since then appearance tyrannizes over truth 
and is lord of happiness, to appearance I must devote my- 
self, I will describe around me a picture and shadow of 
virtue to be the vestibule and exterior of my house; behind 
I will trail the subtle and crafty fox." 


9, Which one of the following best expresses the main 
topic of this selection? 


What is justice? 

How to attain eternal life 
How to be successful 

What is the nature of virtue? 
What is truth ? » 


10. Which of the following might be most inclined to follow 
the policy recommended in the selection? 


An absolute ruler 
A politician 

A philosopher 

A statesman 

A religious leader 
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11. If some external force should shift the earth nearer the 
sun so that the mean radius of its orbit would be eighty 
million miles, the anticipated effect on the earth would 
cause the 


A- seasons to be longer. 

B- sidereal day to be longer. 

C- average yearly temperature to be lower. 
D- year to be shorter. 

E- None of these. 


12. Which one of the following actions would probably be 
least effective in correcting the undesirable features 
of group political pressures ? 


A- Overhaul the national patent system. 

B- Concentrate the economic power of the nation. 

C- Give the public more information about the 
origin and extent of political lobbying. 

D- Use congressional investigating committees. 

E- Encourage all groups to subordinate their 
interests to the national interest. 


13. set the following poem to music: 


py e ror 
(Copy furnished the student) 


Write a simple melodic line. 
Write a composition with a single tonal base. 
Write a composition using two tonal levels. 


Write a specific work in a larger form for any of the accepted 
mediums of expression such as a chamber group, orches- 
tra, chorus, or piano, " The composition should be at least 
ten minutes! duration and have received performance. Sug- 
gested designs are as follows: a string quartet, a trio, or a 
sonata for violin or violincello and piano, or a work for full 
orchestra, or a dramatic work or a cantata for solos, chorus, 
and orchestra of at least fifteen minutes' duration. (Thesis 
requirement for master's degree in music.) 
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PART II 


THE TAXONOMY 
AND 


ILLUSTRATIVE MATERIALS 


1.00 KNOWLEDGE 


Knowledge as defined here includes those behaviors and 
test situations which emphasize the remembering, either by 
recognition or recall, of ideas, material, or phenomena. 
The behavior expected of a student in the recall situation is 
very similar to the behavior he was expected to have during 
the original learning situation. In the learning situation the 
student is expected to store in his mind certain information, 
and the behavior expected later is the remembering of this 
information. Although some alterations may be expected in 
the material to be remembered, this is a relatively minor 
part of the knowledge behavior or test. The process of re- 
lating and judging is also involved to the extent that the stu- 
dent is expected to answer questions or problems which are 
posed in a different form in the test situation than in the 
original learning situation. 


In the classification of the knowledge objectives, the ar- 
rangement is from the specific and relatively concrete types 
of behaviors to the more complex and abstract ones. Thus, 
the knowledge of specifics refers to types of information or 
knowledge which can be isolated and remembered separately, 
while the knowledge of universals and abstractions empha- 
sizes the interrelations „and patterns in which information can 
be organized and structured. 


While it is recognized that knowledge is involved in the 
more complex major categories of the taxonomy (2. 00 to 
6.00), the knowledge category differs from the others 1n that 
remembering is the major psychological process involved ) 
here, while in the other categories the remembering is only 
one part of a much more complex process of relating, judg- 
ing, and reorganizing. 
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1.10 KNOWLEDGE OF SPECIFICS 


The recall of specific and isolable bits of information. -- 
This refers primarily to what might be called the hard core 
of facts or information in each field of knowledge. Such in- 
formation represents the elements the specialist must use in 
communicating about his field, in understanding it, and in or- 
ganizing it systematically. These specifics are usually quite 
serviceable to people working in the field in the very form 
in which they are presented and need little or no alteration 
from one use or application to another. Such specifics also 
become the basic elements the student or learner must know 
if he is to be acquainted with the field or to solve any of the 
problems in it, These specifics usually are symbols which 
have some concrete referents and are, for the most part, at 
a relatively low level of abstraction. There is a tremendous 
wealth of these specifics and there must always be some se- 
lection for educational purposes, since it is almost inconceiv- 
able that a student can learn all of the specifics relevant to à 
particular field. As our knowledge in the social sciences, 
the sciences, and the humanities increases, even the special- 
ist has great difficulty in keeping up with all the new specifics 
found or developed in the field. For classification purposes, 
the specifics may be distinguished from the more complex 
classes of knowledge by virtue of their very specificity, that 
is, they can be isolated as elements or bits which have some 
meaning and value by themselves. 


1.11 - Knowledge of terminology 2 
Knowledge of the referents for specific verbal and non- 


verbal symbols.-- This may include knowledge of the most 
generally accepted symbol referent, knowledge of the variety 
of symbols which may be used for a single referent, or knowl- 
edge of the referent most appropriate to a given use of a sym- 
bol, 


Probably the most basic type of knowledge in a particular 
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field is its terminology. Each field contains a large number 
of symbols, either verbal or non-verbal, which have partic- 
ular referents. These represent the basic language of the 
field--the shorthand used by the workers in a field to express 
what they know. In any attempt by workers to communicate 
with others about phenomena within the field, they find it nec- 
essary to make use of some of the special symbols and terms 
they have devised. In many cases it is impossible for them 
to discuss problems in their field without making use of some 
of the essential terms of that field. Quite literally, they are 
unable to even think about many of the phenomena in the field 


unless they make use of these terms and symbols. The learner 
must become cognizant of these terms and symbols and must 


learn the generally accepted definitions or meanings to be at- 
tached. Just as the specialist in the field must communicate 
by the use of these terms, so the learner or the individual 
reader of the communication must have a knowledge of the 
symbols and their referents before he can comprehend or 
think about the phenomena of the field. 


Here, to a larger extent than in any of the other classes 
of knowledge objectives, there is a likelihood that the spe- 
cialist, finding his own symbols useful and precise, will 
attempt to impose upon the learner a larger number of the 
symbols than the learner really needs, can learn, or will re- 
tain. Especially is this true in many of the sciences which 
attempt to use words and symbols with great precision and 
where the specialist finds it difficult to express the same 
ideas or discuss particular phenomena by the use of other 


symbols or by the use of other terms much more common 
to a lay population. 


1.11 Knowledge of Terminology --Illustrative Educational 


Objectives n 


To define technical terms by giving their attributes, 
properties, or relations. 


The ability to distinguish the referents for words and to 


establish the limits within which a biological term may 
have meaning. 


Familiarity with a large number of words in their com- 
mon range of meanings. 


A ENE aaa Lao mse 
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Knowledge of the vocabulary of the fine arts sufficient 
to be able to read and converse intelligently. 


To acquire an understanding of the vocabulary used in 
quantitative thinking. 


Knowledge of the terms and concepts peculiar to work 
in science. 


Knowledge of important accounting terms. 
Mastery of the terms peculiar to work in science. 


To acquire an understanding of the terminology associ- 
ated with geometric figures on a plane. 


1.12 - Knowledge of Specific Facts 


Knowledge of dates, events, persons, places, sources 
of information, etc. -- This may include very precise and spe- 
cific information, such as the exact date of an event or the 
exact magnitude of a phenomenon. 1t may also include ap- 
proximate information, such as a time period in which an 
event occurred or the general order of magnitude of a phenom- 
enon. Knowledge of specific facts refers to those facts which 
can be isolated as separate, discrete elements in contrast to 
those which can only be known in a larger context. 


In every field there are a large number of dates, events, 
persons, places, findings, etc., known by the specialist 
which represent findings or knowledge about the field. These 
can be distinguished from the terminology in that the termi- 
nology generally represents the conventions or agreements 
within a field, while the facts are moxe likely to represent 
the findings which can be tested by other means than deter- 
mining the unanimity of workers in the field or the agreements 
they have made for purposes of communication. Such specific 
facts also represent basic elements which the specialist must 
use in presenting communications about the field and in think- 
ing about specific problems or topics in the field. It Should 
also be recognized that this classification includes knowledge 
about particular books, writing, and sources of information 
on specific topics and problems. Thus, knowledge of a spe- 
cific fact as well as knowledge of the source which deals with 
the fact are both classifiable under this heading. 
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Again, there is usually a tremendous number of such 
specific facts and the teacher or curriculum specialist must 
make choices as to what is basic and what is only of second- 
ary importance or of importance primarily to the specialist. 
The teacher is also confronted with the problem of level of 
precision with which different information must be known. 
Thus, quite frequently he may be content to have a student 
learn only the approximate magnitude of the phenomenon 
rather than its precise quantity or to learn an approximate 
time period rather than the precise date or time of a specific 
event. The teacher also has a considerable problem in 
determining whether many of the specific facts are such that 
the student can learn them whenever he really needs them, 
or whether they should be learned during and as part of an 
educational unit or course. 


1.12 Knowledge of Specific Facts--Illustrative Educational 
Objectives 


The recall of major facts about particular cultures. 


The possession of a minimum knowledge about the or- 
ganisms studied in the laboratory. 


Knowledge of biological facts important to a systematic 
understanding of biological processes. 


Recall and recognition of factual information about con- 
temporary society. 


Knowledge of practical biological facts important to 
health, citizenship, and other human needs. 


Acquiring information about major natural resources. 


Acquiring information about various important aspects 
of nutrition. 


Recall and recognition of what is characteristic of par- 
ticular periods. 


Knowledge of physical and chemical properties of common 
elements and their compounds. 
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An acquaintance with the more significant names, 
places, and events in the news. 


A knowledge of the reputation of a given author for pre- 
senting and interpreting facts on governmental prob- 
lems. 


Knowledge of reliable sources of information for 
wise purchasing. 
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1.20 KNOWLEDGE OF WAYS AND MEANS 
OF DEALING WITH SPECIFICS 


Knowledge of the ways of organizing, studying, judging, 


and criticizing ideas and phenomena. --This includes the 
methods of inquiry, the chronological sequences, and the 
standards of judgment within a field as well as the patterns 
of organization through which the areas of the fields them- 
selves are determined and internally organized. 


At a somewhat more abstract level than the specifics 
are the methods of organizing and dealing with them. Each 
subject field has a body of techniques, criteria, classifica- 
tions, and forms which are used to discover specifics as 
well as to deal with them once they are discovered. These 
differ from the specifics in that they form the connecting 
links between specifics, the operations necessary to estab- 
lish or deal with specifics, and the criteria by which specif- 
ics are judged and evaluated. It must be made clear that 
this class of behaviors is only a very limited one as uséd 
here. It does not involve actual use of the ways and means 
so much as it does a knowledge of their existence and possi- 
ble use. The actual skills and abilities which involve their 
use are described in the 2.00 to 6.00 classes of the taxon- 
omy. 


Although it will frequently be found difficult to distin- 
guish knowledge of ways and means from knowledge of spe- | 
cifics for purposes of classification, several characteristics | 
will be useful in making these distinctions. Ways and means 
will refer to processes rather than products. They will in- 
dicate operations rather than the results of operations. They 
will include knowledge which is largely the result of agree- 
ment and convenience father than the knowledge which is 
more directly a matter of observation, experimentation, and 
discovery. They will more commonly be reflections of how 
workers in the field think and attack problems rather than 
the results of such thought or problem solving. | 


Although this class does not differ greatly from 1.10 - 
Knowledge of Specifics, it appears likely that students will 
have greater difficulty in learning this knowledge because of 
its greater abstractness. Added difficulty may occur be- 
cause many of the ways and means may represent relatively 
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arbitrary and even artificial forms which are meaningful 
only to the specialist who recognizes their value as tools 
and techniques in his work. 


1.21 - Knowledge of Conventions 


Knowledge of characteristic ways of treating and pre- 
senting ideas and phenomena. — These are the usages, 
Styles, and practices which are employed in a field because 
the workers find they suit their purposes or because they 
appear to suit the phenomena with which they deal. This 
may include such varied phenomena as conventional sym- 
bols used in map making and dictionaries, rules of social 
behavior, and rules, styles, or practices commonly em- 
ployed in scholarly fields. 


There are many conventions and rules which the work- 
ers in a field find extremely useful in dealing with the phe- 
nomena of a field. Although many such conventions may be 
retained because of habit and tradition rather than useful- 
ness, at some point in time they were found to be especially 
Significant in giving some structure to the phenomena. Gen- 
erally these conventions will have an arbitrary existence 
Since they were developed or retained because of general 
agreement or concurrence of workers in the field. They are 
usually true only as a matter of definition and practice rath- 
er than as a result of discovery or observation. 


In some fields these conventions make up the largest 
proportion of the knowledge of the field. It is likely that 
Students are more willing to accept and learn this type of 
knowledge in the early school years than in the later years 


of formal education. 
6 


1.21 Knowledge of Conventions--Illustrative Educational 


Objectives ' 

Familiarity with the forms and conventions of the major 
types of works, e.g., verse, plays, scientific papers, 
etc, 


To make pupils conscious of correct form and usage in 
speech and writing. 


Knowledge of common rules of etiquette. 
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To develop a knowledge of acceptable forms of language. 


Knowledge of the ways in which symbols are used to in- 
dicate the correct pronunciation of words. 


Knowledge of the standard representational devices and 
symbols in maps and charts. 


A knowledge of the rules of punctuation. 


1.22 - Knowledge of Trends and Sequences 


Knowledge of the processes, directions, and movements 
of phenomena with respect to time. --It includes trends as at- 


tempts to point up the interrelationship among a number of 
specific events which are separated by time. It also includes 
representations of processes which may involve time as well 
as causal interrelations of a series of specific events. Out 
of an almost infinite number of specific events, particular 
workers have selected those which they believe point to a 
trend or sequence. In this respect trends and Sequences are 
those relationships and processes which have been selected 
or emphasized by the workers in the field. Many of the 
trends and sequences are difficult to communicate because 
they involve highly dynamic actions, processes, and move- 
ments which are not fully represented by static verbal, 
graphic, or symbolic forms. 


Students may have difficulty in learning trends and se- 
quences unless they are also familiar with the specifics on 
which such trends and sequences are based. 


1.22 Knowledge of Trends and Sequences--Illustrative Edu- 


cational Objectivés 


Understanding of the continuity and development of 
American culture as exemplified in American life. 


Knowledge of the basic trends underlying the development 
of public assistance programs with particular reference 
to such programs as WPA, PWA, etc., developed during 
the depression. 


Knowledge of trends in government in the United States 
during the last fifty years. 
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To develop a basic knowledge of the evolutionary devel- 
opment of man, 


To develop a knowledge of effects of industrialization on 
the culture and international relations of a nation. 


To know and describe the forces which determine and 
shape public policies. 


To understand the increasing importance of administra- 
tive departments of the national government in formulat- 


ing public policies. 


To know how Greek civilization has affected the con- 
temporary world, 


To know how militarism and imperialism have been of 
causal importance for the world wars. 


To develop a knowledge of how hereditary and environ- 
mental factors interrelate to influence the development 
of the individual. 


A knowledge of the forces, past and present, which have 
made for the increasing interdependence of people all 
over the world. 


1,23 - Knowledge of Classifications and Categories 


Knowledge of the classes, sets, divisions, and arrange- 
ments which are regarded as fundamental or useful for a 
given subject field, purpose, argument, or problem. --As a 


Subject field, problem, or topic becomes well developed, 
individuals working on it find it useful to develop classifi- 
cations and categories which help to structure and systema- 
tize the phenomena. These classifications and categories 
are likely to have an arbitrary and artificial flavor to the stu- 
dent, although the Specialist finds them useful and even funda- 
mental for his work. The individual student is expected to 
know these classifications and to know when they are appro- 
priate. However, under the present heading is included only 
knowledge of the classifications and categories, while the ap- 
plication of these to new problems is dealt with in other parts 
of the taxonomy. 
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1.23 Knowledge of Classification and Categories--Illustra- 


tive Educational Objectives 


To recognize the area encompassed by various kinds of 
problems or materials. 


Becoming familiar with a range of types of literature. 


Knowledge of the features of various forms of business 
ownership. 


1.24 - Knowledge of Criteria 
Knowledge of the criteria by which facts, principles, 


opinions, and conduct are tested or judged. -- Here again is a 
Systematization which is found useful by workers attacking 
the problems of a field. Students may be expected to make 
use of the criteria as well as to have a knowledge of them. 
The utilization of the criteria in actual problem situations 
will be found in 6.00 - Evaluation. The criteria will vary 
markedly from field to field. They are likely to appear com- 
plex and abstract to students and to acquire meaning only as 
they are related to concrete situations and problems. 
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1.24 Knowledge of Criteria--Illustrative Educational Ob- 
jectives 


Familiarity with criteria for judgment appropriate to 
the type of work and the purpose for which it is read. 


Knowledge of criteria forthe evaluation of recreational 
activities. 


Knowledge of the criteria by which a valid source of 
information in the social sciences can be recognized. 


Knowledge of the criteria by which the nutritive value 
of a meal can be judged. 


Knowledge of the basic elements (balance, unity, rhythm, 
etc.) which can be used to judge a work of art. 


Knowledge of the criteria by which home economists 
judge the relative proportions of income distributed 
for different purposes by a family. 


1.25 - Knowledge of Methodology 


Knowledge of the methods of inquiry, techniques, and 
procedures employed in a particular subject field as well 
as those employed in investigating particular problems and 


phenomena. --Here, again, the emphasis is on the individ- 
ual's knowledge of the methods rather than on his ability to 
use the methods in the ways defined by categories 3.00 to 
6.00. However, the student is frequently required to know 
about methods and techniques and to know the ways in which 
they have been used. Such knowledge is most nearly of an 
historical or encyclopedic type. This knowledge, although 
simpler and perhaps less functional than the ability to actu- 
ally employ the methods and techniques, is an important pre- 
lude to such use. Thus before engaging in an inquiry the stu- 
dent may be expected to know about the methods and tech- 
niques which have been employed in similar inquiries. Ata 
later stage in his inquiry he may be expected to show rela- 
tions between the methods he has employed and the methods 
employed by others. 


74 


1.25 Knowledge of Methodology--Hlustrative Educational 
Objectives 


The student shall know the methods of attack relevant 
to the kinds of problems of concern to the social sci- 
ences. 


Knowledge of scientific methods for evaluating health 
concepts. 


Knowledge of the techniques and methods used by sci- 
entists in seeking to answer questions about the world. 
[i 
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1.30 KNOWLEDGE OF THE UNIVERSALS 
AND ABSTRACTIONS IN A FIELD 


Knowledge of the major ideas, schemes, and patterns 
by which phenomena and ideas are organized. --These are 


the large structures, theories, and generalizations which 
dominate a subject field or which are quite generally used 
in studying phenomena or solving problems. These are at 
the highest levels of abstraction and complexity, 


These concepts bring togethera large number of specific 
facts and events, describe the processes and  interrela- 
tions among these specifics, and thus enable the worker to 
organize the whole in a parsimonious form. 


These tend to be very broad ideas and plans which are 
rather difficult for students to comprehend. Quite frequently 
they are so difficult because the student is not thoroughly ac- 
quainted with the phenomena the universals are intended to 
summarize and organize. If the student does get to know 
them, however, he has a means of relating and organizing a 
great deal of subject matter and as a result should have more 
insight into the field as well as greater retentiveness for it. 


1.31 - Knowledge of Principles and Generalizations 


Knowledge of particular abstractions which summarize 
observations of phenomena. --These are the abstractions 


which are of greatest value in explaining, describing, pre- 
dicting, or in determining the most appropriate and relevant 
action or direction to be taken, Here all that is required is 
that the student know the principle or generalization, that is, 
that he be able to recognize or recall correct versions of 
them. The actual application of these abstractions in problem 
situations is included in 3. 00 - Application. However, the re- 
call of the principle or generalization as well as the recall of 
the specific illustrations of them utilized in the instructional 
material may be included in the present category. 


TSL Knowledge of Principles and Generalizations --Illustra- 


tive Educational Objectives 


Knowledge of the important principles by which our ex- 
perience with biological phenomena is summarized, 
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The recall of major generalizations about particular cul- 
tures. 


Knowledge of propositions, of fundamental logical prin- 
ciples, of propositional functions and quantifiers, and 
of sets. 


Knowledge of the principles of chemistry which are rel- 
evant to life-processes and to health. 


Knowledge of biological laws of reproduction and hered- 
ity. 


Understanding of some of the principal elements in the 
heritage of Western civilization. 


Knowledge of the major principles of high school chem- 
istry. 


To know the implications of our foreign trade policies 


for the international economy and for international 
goodwill. 


To know the major principles involved in learning. 


To become familiar with the plant illustrations of the 
principal laws of heredity and evolution. 


To develop an understanding of such basic biological 
principles as cell theory, osmosis, and photosynthesis. 


To develop a knowledge of the principles of federalism. 


1.32 - Knowledge of Theories and Structures 


Knowledge of the body of princi les and generalizations 
together with their interrelations which resent a clear, round- 
ed, and systematic view of a complex phenomenon, problem, 
or field. --These are the most abstract formulations, They 
can be used to show the interrelation and organization of a 
great range of specifics. This category differs from 1.31 in 
that here the emphasis is on a body of principles and general- 
izations which are interrelated to form a theory or structure, 
while the principles and generalizations in 1.31 are treated 
as particulars which need not be related to each other. 
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1.32 Knowledge of Theories and Structures --Illustrative 


Educational Objectives 
The recall of major theories about particular cultures. 


Recall and recognition of what is contained in particular 
cultures. 


Knowledge of the philosophic bases for particular judg- 
ments. 


Understanding of the interrelations of chemical princi- 
ples and theories. 


To understand the structure and organization of Congress. 


To understand the basic structural organization of the 
local city government. 


Knowledge of a relatively complete formulation of the 
theory of evolution. 
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Testing for Knowledge, and illustrative test items 


The major behavior tested in knowledge is whether or 
not the student can remember and either cite or recognize 
accurate statements in response to particular questions. Al- 
though somewhat more than rote memory is required for 
knowledge, the form of the question and the level of precision 
and exactness required should not be too different from the 
way in which the knowledge was originally learned. This 
means that the choices in the recognition form of question 
must be at the level of discrimination originally intended by 
the learning rather than at an entirely different level. 


Probably the art of testing has been developed to the 
greatest extent in the measurement of knowledge. This type 
of behavior can be measured with great efficiency and econ- 
omy, and a relatively small sample of problems and questions 
in this area can be used to test a very large universe of knowl- 
edge. Some efforts have been made to explore the kinds of er- 
rors students make in their reactions to knowledge questions. 
The analysis of such errors may frequently be useful in plan- 
ning alternative choices for recognition questions, and the use 
of scores or summaries of such errors may be useful in de- 
termining the accuracy and precision of the student's knowl- 
edge and the limits within which this knowledge may be said 
to be known. 


There is little point in making a very elaborate analysis 
of the testing procedures which are appropriate here, since 
most readers are quite familiar with adequate testing tech- 
niques for this purpose. For this reason, and for economy 
of space, only a minimum number of test illustrations are of- 


fered with only occasional comments on Specific features of 
these illustrations. ə 


1.00 - KNOWLEDGE -- ILLUSTRATIVE TEST ITEMS 


1.10 Knowledge of Specifics 


1,11 Knowledge of Terminology 


1. A synapse can best be described as 

1, a mass or layer of protoplasm having many nuclei but lacking 
distinct cell boundaries. 

2. a lapse of memory caused by inadequate circulation of blood 
to the brain. 

3. the pairing of maternal with paternal chromosomes during 
maturation of the germ cells. 

4. the long cylindrical portion of an axon. 

5. the point at which the nervous impulse passes from one 
neuron to another. 


2, Whichone ofthe following phrases about wave motion defines period? 
1. The maximum distance a particle is displaced from its point 
of rest. 
2. The length of time required for a particle to make a complete 
vibration. 
3. The number of complete vibrations per second. 
4. The time rate of change of distance in a given direction. 


Directions: In each group below, select the numbered word or phrase 
which most nearly corresponds in meaning to the word at the head of 
that group, and put its number in the parentheses at the right. 


3. antelope 
1, fruit 2. animal 3. prelude 4. feeler 5. gallop 


4. spaniel - type of 
1. sword 2. dog 3. lace 4. horse 5. coin 


1.12 Knowledge of Specific Facts 


5. Jean Valjean was first sentenced to the galleys for stealing 
1, the Bishop's candlesticks. 
2. a loaf of bread. 
3. a few sticks of wood. c 
4. a widow's cow. 
5. the cloth fr¢m off the altar. 


6. The Monroe Doctrine was announced about ten years after the 
1. Revolutionary War. 
2. War of 1812. 
3. Civil War, 
4. Spanish-American War. 


7. About what proportion of the population of the United States is living 
on farms ? 
1. 10% 2. 20% 3. 35% 4. 50% 5. 60% 
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1,12 Knowledge of Specific Facts 


Directions: The following paired statements refer to structures, func- 
tions, or factors which are to be compared in the quantitative sense, 
Blacken answer space 


A- if the thing described on the left is greater than that on the 


right; 
B- if the thing described on the left is less than that on the right; 


C- if the left and the right are essentially the the same. 


8. Number of rabbits in (A) is gr. than number of foxes in the 
a food web (B) is ls. than same food web. 
(C) is sa. as 


9. Maximum size of food (A) is gr. than maximum size of food 
particle that can be (B) is ls. than particle that can be eaten 


eaten by a sponge (C) is sa. as by a coelenterate. 

10. Number of annual (A) is gr. than number of annual rings at 
rings at base of the (B) is ls. than point half-way up the trunk 
trunk of an old tree (C) is sa. as of the same tree. 


11. A sodium ion differs from a sodium atom in that 
A- itis an isotope of sodium. 
B- it is more reactive. 
C- it has a positive charge on its nucleus. 
D- it exists only in solution. 
E- it has fewer electrons. 


Directions: Blacken the answer space corresponding to the work of art 
which is earliest in date. 


12. A- Browning's Fra Fra Lippo Lippi 


B- Whitman's When Lilacs Last in the Dooryard Bloomed 
C- Tristan and Isolde 


D- Shelley's Ode to the West Wind 
E- Seurat's Sunday Afternoon on the Grande Jatte 


Directions: For each of the following items, blacken answer space | 


A- ifit was in the Articles of Confederation; 
B- ifit was in the Constitution of 1787; 


C- ifit was in the Bill of Right Rights (Amendments I-X); 
D- ifit was in Amendments XI-XXI; 
E- ifit was in two or more of the above. 


13. Protected life, liberty and property against governmental action 
without due process of law 


14. Provided for popular election of United States Senators 
15. Provided for a unicameral legislature 


16. Gave the treaty-making power to Congress 
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1.21 Knowledge of Conventions 


Directions: Read each of the following groups of sentences carefully, 
then decide which sentence in each group is better than the other sen- 
tences in that group. 


17. 1. He was energetic and ambitious, his brother being lazy and 

indifferent. 

2. He was energetic and ambitious, but his brother was lazy and 
indifferent. 

3. He was energetic and ambitious, as his brother was lazy and 
indifferent. 

4. He was energetic and ambitious, and his brother was lazy and 
indifferent. 


Directions: Select from the several choices given in each of the follow- 
ing items the one which you consider best. 


18. Ibelieve he (1) done, (2) did the best that he could, 


19. Magnetic poles are usually named 
plus and minus. 

red and blue. 

east and west. 

north and south. 

anode and cathode. 


CO PWM 


20. For computation purposes, forces are frequently represented by 
Straight lines. 

circles. 

arcs of a circle. 

angles. 

objects of three dimensions. 


OC a o 


21. Which one of the following should not be classified as payment for 
the services of labor? 
1. The commissions earned by a real estate salesman 
2. The fee paid a justice of the peace for performing a marriage 
3. The dividend paid the owner of preferred stock 
4. The salary of a United States senator 


Directions: Indicate whether each of the following statements is (1) a 
fact (2) an opinion or judgment (3) neither a fact nor an opinion. 


22. A man who works forty hours per week, fifty weeks per year, at 
one dollar per hour, earns an annual wage of $2000. 


23. Many workers do not earn $2000 per year. 


24, Unemployment insurance would provide some income for the fami- 
lies of unemployed workers. 
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25. 


The first movement of a sonata is commonly distinguished from 
the others by its greater 

1. rapidity and gayety. 

2. length and complexity. 

3. emotional abandon. 

4. sweetness and charm. 

5. structural informality. 


Directions: Blacken one answer space for each item according to the 
following: 


26, 


27. 


28. 


29. 


A- if the statement applies to the symphonic poem; 
B- if the statement applies to the fugue; 

C- if the statement applies to the motet; 

D- if the statement applies to the suite; 

E- if the statement applies to the sonata. 


Mozart's Symphony in G Minor, though composed for orchestra, is 
representative of this type in the number, order, and form of its 
various movements. 


The minuet is the only dance movement commonly included in this 
musical type. 


Instrumental works representative of this type are usually based 
upon extra-musical ideas, either poetic or descriptive. 


A work of this type may include among its different movements an 
overture or prelude, an air, anda gigue. 


1.22 Knowledge of Trends and Sequences 


30. 


31. 


During the process of breathing 

l. the air pressure outside is greater than that within the lungs 
at the end of an inhalation. 

2. the pressure within the lungs is greater than that outside at 
the end of an inhalation. 

3. the chest cavity has the smallest volume at the end of an 
inhalation, 

4. the air pressure within the lungs is greater than that outside 
at the end of an exhalation, 


5. the pressure inside and outside the lungs is equal at the end 
of an inhalation. 


Which of the above curves represents the change of solubility of 
potassium nitrate with an increase in temperature? (Curves not 


1. AB Shown here) 
2. CD 

3. EF 

4. GH 

by CE 


32. 


33. 


34. 
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The stages in the life history of the housefly are, in order, 
l. larva - egg - pupa - adult. 

pupa - larva - egg - adult. 

pupa - egg - larva - adult. 

egg - larva - adult - pupa. 

egg - larva - pupa - adult. 


oO pwn 


Which of the following best describes the policy of the government 
toward railroads in the twenty years following the Civil War? 
l. Purchase of railroads by the government after they had been 
privately financed and constructed 
2. Sale of publicly constructed railroads to private companies 
3. Granting of government subsidies to privately owned 
and constructed roads 
4, Little effort to encourage railroad construction 


The latter part of the nineteenth century was notable for 

1. the consolidation of small businesses into larger organiza- 
tions. 

2. the appearance of the "partnership" type of business organi- 
zation. 

3. government restriction on unduly large profits. 

4. the decreased importance of the middleman between pro- 
ducer and consumer. 


1.23 Knowledge of Classification and Cate ories 


35. 


36. 


37. 


38. 


39. 


In all fairly complex animals the skeleton and the muscles are 
developed from the primary germ layer known as the 

l. ectoderm. 4. endoderm. 

2. neurocoele. 5. mesoderm. 

3. epithelium. 


It is found that a specialized cell conducts impulses, but performs 
no other function well. Such a cell would best be classified as a(n) 


l. muscle cell. 4. cartilage cell. 
2. gland cell. 5. nerve cell. 
3. epithelial cell. * 
An engineer whe designs houses is called 
1. a carpenter. 4. a draftsman. 
2. a civil engineer. 5. a mechanical engineer. 


3. an architect. 


Which of the following is a chemical change ? 
1. Evaporation of alcohol 4. Melting of wax 
2. Freezing of water 5. Mixing of sand and sugar 


3. Burning of oil 


The branch of biological science which deals with the Structure of 
living organisms is called 

l. physiology. 3. ecology. 5. embryology. 

2. pathology. 4. anatomy. 
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1.24 Knowledge of Criteria -- Illustrative Test Items 


Directions: 


In the following, select the one best completion. 


In the preface to the second edition of the Critique of Pure Reason, Kant 
discusses the problem of placing metaphysics upon the secure path of a 


Science. 


40. By science in this context he means 


A- 


41. Inthe 


a body of generalizations whose truth is guaranteed by ob- 
servation of facts. 

demonstrations of conclusions from assumptions which must 
always retain a hypothetical character. 

dialectic in the Platonic sense. 

a body of knowledge corresponding closely to the intellectual 
virtue called "scientific knowledge" by Aristotle. 


view of John Ruskin, the greatest picture is 

that which imitates best. 

that which teaches us most. 

that which exhibits the greatest power. 

that which conveys the greatest number of the greatest ideas. 


42. The criterion Darwin uses to distinguish the more variable species 
from the less variable species in Chapter II is 


A- 
B- 
C- 
D- 
EB- 


number of individuals in the species. 

frequency of individual differences in the species. 
number of varieties in the species. 

number of closely related species. 


number of different climatic conditions tolerated by the 
species. 
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1.25 Knowledge of Methodology 


43. 


44. 


45. 


46. 


4. 


48. 


A scientist discovers new facts by 

consulting the writings of Aristotle. 

thinking about the probabilities. 

making careful observations and conducting experiments. 
debating questions with his friends. 

referring to the works of Darwin. 


C s 0 I - 


We wish to know whether overeating affects the probable length of 
life. A scientific approach to this problem would be to 

1. see what the ancient Greek philosophers thought about the 
matter. 

2. perform a laboratory experiment with two groups of white 
rats, one group consistently overfed and the other group 
kept on a normal diet. 

3. ask fifty people selected at random and determine their 
average opinion. 

4. study food advertisements that relate to the problem. 

5. ask ten old people what they ate. 


One use of the Periodic Table has been to 
1. determine the solubility of gases. 
find the degree of ionization of many compounds. 


2. 
3. predict undiscovered elements. 
4. determine molecular weights of compounds accurately. 


When the scientist is confronted with a problem, his first step 
toward solving it should usually be to 

construct or purchase equipment. 

perform an experiment. 


draw conclusions. 
urge other scientists to cooperate with him in working it out. 


gather all available information on the subject. 
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Of the following, which represents the most important differences 
between the scientific method as used in the Social sciences and as 
used in the natural sciences? 

1. Employment of the deductive rather than the inductive method 
of reasoning. 
Study of the developmental aspegts of various problems. 
Necessity of regarding hypotheses as tentative in nature. 
Importéice of understanding the problem of causation. 
Necessity of recognizing the value judgments of the inves- 


tigator. 
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Stars are composed of the same elements as are found on the earth. 
Which of the following sources yields information supporting this 
statement? 

1, Observations of absorption spectra of dark interstellar 
matter. 
Observations of spectra of stars. 
Observations of brightness of stars. 
Observations of density of stars. 
Observations of the wave length of maximum ra 
stars. 


diation from 


oF E 
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49, Fossils in rocks constitute valuable clues to the past. Some of 
these fossils are identical with animals existing today. How does 
this affect the investigation of geological history? 

1. Such fossils make the work much simpler since they can be 
easily traced. 

2. These fossils are rare and therefore do not weaken the over- 
all results very much. 

3. These fossils are extremely valuable since observation of 
their living counterparts yields much information as to 
climates and physical conditions of the geologic past. 

4. The existence of living counterparts of fossils is immaterial 
since only the fossil itself is important. 


50. Which of the following provides the best method for determining 
the radius of a star? 

1. Measure the distance to the star and the diameter of the 
image of the star in a telescope of known length; the radius 
can be then obtained geometrically. 

2. Measure the distance, apparent brightness, and surface 
temperature. From the calculated brightness of a Square 
centimeter of surface at that temperature and the absolute 
brightness, the area of the disk, and hence the radius is 
determined. 

3. The speed of rotation of the edge of disk of a rotating star 
can be measured from the Doppler shift. From this and the 
period of rotation the radius can be derived. 

4. In double stars the gravitational attraction depends on the 
density and the volume, hence the radius can be determined. 


1.30 Knowledge of the Universals and Abstractions in a Field 


1.31 Knowledge of Principles and Generalizations 


51. Which of the following is the best description of the pattern of 
Society in the 18th century colonies? 

l. A system of fixed castes ranging from the slave at the bottom 
through the indentured servant, the free workman, the small 
farmer, to the nobility at the top. 

2. A system of voluntary contracts among substantially equal 
individuals differentiated only by the amount of wealth they 
possessed. j 

3. A hierarchy of social classes ranging from the nobility at the 
top, who controlled the society, to the indentured servant 
and slave at the bottom, who did the heavy work. 

4. A hierarchy of social classes in which individuals moved up 
and down with comparative ease and Speed, except the black 
Slaves, and in which a very large number objected to the 
continuance of well-defined classes. 


52. 


53. 


54. 


55. 


87 


Which one of the following is the best summary of Calhoun's views 


about the nature of the union? 


1. It is a compact formed between sovereign states, each of 
which retains the right to interpose its authority. 

2. It is a compact formed between sovereign states, but the 
states have no right to interpose. 

3. It is an instrument adopted by the American people, as one 


aggregate community. 


If the volume of a given mass of gas is kept constant, the pressure 


may be diminished by 
1, reducing the temperature. 
2. raising the temperature. 
3. adding heat. 


4, 
5. 


decreasing the density. 
increasing the density. 


e generalizations concerning the common metals are that 


all the simple salts of the alkali metals are soluble. 
the metals of the alkaline earth group are precipitated as 


carbonates. 


m. 
1. most of the metals form only one insoluble salt. 
2 
3 


4. the alkali carbonates are insoluble in water. 
5. many of the heavy metal sulfides are insoluble in neutral or 


slightly acid solution. 


Which of the following statements of the relationship between mar- 
ket price and normal price is true? 
1. Over a short period of time, market price varies directly 
with changes in normal price. 

2. Over a long period of time, market price tends to equal 


normal price. 


3. Market price is usually lower than normal price. 
4. Over a long period of time, market price determines 


normal price. 


Directions: For items 56-59 select from the five principles at the right 
the most closely related principle and mark the corresponding answer 
Space. 


56. 


57. 


58. 


59. 


Statements 


Fossils of primates first appear 
in the Cenozoic rock strata, 
while trilobitg remains are 
found in the Protorozoic rocks. 


The Arctic and Antarctic regions 
are sparsely populated. 


Plants have no nervous system. 


Large coal beds exist in 
Alaska, 


1, 


Principles 


There have been profound 
"changes in the climate on 
the earth. 
Coordination and integration 
of action is generally slower 
in plants tharf in animals. 
There is an increasing com- 
plexity of structure and 
function from lower to high- 
er forms of life. 
All life comes from life and 
produces its own kind of liv- 
ing organisms. 
Light is a limiting factor to 
life. 
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1.32 Knowledge of Theories and Structures 


Directions: Items 60-62 are concerned with possible evidences in sup- 
port of the theory of biological evolution, Select from the key list the 
category to which the evidence mentioned in the item belongs. 


Comparative anatomy 
Comparative physiology 
Classification 
Embryology 
Paleontology 


[20 wye 


60. Intergrading forms of plants and animals differing from earlier 
species indicate that evolutionary change is probably taking place 
today in all living organisms. 


61, Hematin crystals from the hemoglobin of various vertebrates have 
the same chemical composition. 


62. The human heart has two chambers at a very early developmental 
stage. 


2.00 - COMPREHENSION 


Probably the largest general class of intellectual abili- 
ties and skills emphasized in schools and colleges are those 
which involve comprehension. That is, when students are 
confronted with a communication, they are expectedto know 
what is being communicated and to be able to make some 
use of the material or ideas contained in it. The communi- 
cation may be in oral or written form, in verbal orsymbolic 
form, or, if we allow a relatively broad use of the term 
"communication," it may refer to material in concrete form 
as wellas to material embodied on paper. For instance, we 
commonly expect comprehension of aphysics demonstration, 
à geologic formation viewed on a field trip, à building illus- 
trating a particular architectual feature, a musical work 
played by an orchestra. And, of course, we speak of com- 
prehension of the above phenomena when presented in verbal, 
pictorial, or symbolic form on paper. 


Although the term "comprehension" has been frequently 
associated with reading, e.g., reading comprehension, the 
use to which it is being put here is a somewhat broader one 
in that it is related to a greater variety of communications 
than that encompassed by written verbal materials. In an- 
other sense, the use of the term here is somewhat more 
limited than usual, since comprehensionis not made synony- 
mous with complete understanding or even with the fullest 
grasp of a message. Here we are using the term "compre- 
hension" to include those objectives, behaviors, or responses 
which represent an understanding ofthe literal message con- 
tained in a communication. In reaching such understanding, 
the student may change the communication in his mind or in 
his overt responses to some parallel form more meaningful 
to him. There may also be responses which represent sim- 
ple extensions beyond what is given in the communication 
itself. 


Three types of comprehension behavior are considered 
here. The first is translation which means that an individual 
can put a communication into other language, into other terms, 
or into another form of communication. It will usually in- 
volve the giving of meaningto the various parts of a commu- 
nication, taken in isolation, although such meanings may in 
part be determined by the context in which the ideas appear. 
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The second type of behavior is interpretation which in- 
volves dealing with a communication as a configuration of 
ideas whose comprehension may require a reordering of the 
ideas into a new configuration in the mind of the individual. 
This also includes thinking about the relative importance of 
the ideas, their interrelationships, and their relevance to 
generalizations implied or described in the original commu- 
nication. Evidence of interpretation behavior may be found 
in the inferences, generalizations, or summarizations pro- 
duced by the individual. Interpretation as here defined dif- 
fers from analysis. In the latter the emphasis is on the 
form, the organization, the effectiveness, and the logic of 
the communication. It differs from application in that ap- 
plication is more definitely concerned with the meanings a 
communication has for other generalizations, situations, 
and phenomena, or the meanings that generalizations known 
by the student have for the communication. It differs from 
evaluation in that evaluation is characterized by the formu- 
lating of judgments explicitly based on criteria. 


The third type of behavior to be considered under com- 
prehension is extrapolation. It includes the making of esti- 
mates or predictions based on understanding of the trends, 
tendencies, or conditions described in the communication. 
It may also involve the making of inferences with respect to 
implications, consequences, corollaries and effects which 
are in accordance with the conditions described in the com- 
munication. It differs from application, however, in that 
the thinking is based on what is given rather than on some 
abstraction brought from the other experiences to the situ- 
ation, such as a general principle or rule of procedure. Ex- 
trapolationmay include judgments with respect toa universe 
where the communication characterizes a Sample, or con- 
versely with respect to,a sample where the communication 
describes a universe. For the purpose of classification, 
interpolation may be regarded as a type of “extrapolation in 
that judgments with respect to intervals within a sequence 
of data presented ina communication are similar to judg- 


ERN going beyond the data in the usual sense of extrapola- 
ion. 


i Each of these types of educational objectives or behavior 
is further treated in the following, 
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2.10 Translation 


Translation behavior occupies a transitional position be- 
tween the behaviors classified under the category of knowl- 
edge and types of behavior described under the headings of 
interpretation, extrapolation, analysis, synthesis, applica- 
tion, and evaluation. It will usually be found that individual 
competence in translation is dependent on the possession of 
the requisite or relevant knowledge. It is also true that un- 
less an individual can give the denoted meaning to each of the 
various parts of a communication and/or in terms of immedi- 
ate or adjacent context, he will be unable to engage in more 
complex thinking about the communication. For such think- 
ing, a given term ina communication must symbolize for the 
individual a general concept or even an aggregate of relevant 
ideas. An abstract idea may need to be transformed to con- 
crete or everyday terms to be useful in further thinking 
about some problem presented by the communication. Some- 
times an extended part of a communication may need to be 
translated into briefer, or even more abstract, terms or 
symbols, to facilitate thinking. This type of translation may 
carry over into more complex behavior, such as analysis, 
Synthesis or application, when previous instruction has not 
made such translation explicit. On the other hand, when 
instruction has emphasized the particular points involved, 
the translation may be more akin to simple recall of knowl- 
edge. 
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2.10 Translation -- Illustrative Educational Objectives 
Translation from one level of abstraction to another 
The ability to translate a problem given in technical 
or abstract phraseology into concrete or less abstract 


phraseology--''state the problem in your own words. 


The ability to translate a lengthy part of a communi- 
cation into briefer or more abstract terms. 


The ability to translate an abstraction, such as some 
general principle, by giving an illustration or sample. 


Translation from symbolic form to another form, or vice 
versa 


The ability to translate relationships expressed in 
symbolic form, including illustrations, maps, tables, 


diagrams, graphs, and mathematical and other formu- 
las, to verbal form and vice versa. 


Given geometric concepts in verbal terms, the ability 
to translate into visual or spatial terms. 


The ability to prepare graphical representations of 
physical phenomena or of observed or recorded data. 


The ability to read musical scores. 


The ability to read an architectural plan, 


D 


Translation from one verbal form to another 


The ability to translate non-literal statements 


(metaphor, symbolism, irony, exaggeration) to 
ordinary English. 
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The ability to comprehend the significance of the 
particular words of a poem in the light of their 
context. 


The ability to translate (with or without a dictionary) 
foreign language prose or poetry into good English. 


2.20 Interpretation 


In order to interpret a communication, the reader must 
first of all be able to translate each of the major parts of 
it--this includes not only the words and phrases, but also 
the various representational devices used. He must then be 
able to go beyond this part-for-part rendering of the com- 
munication to comprehend the relationships between its 
various parts, to reorder, or to rearrange it in his mind so 
as to secure some total view of what the communication con- 
tains and to relate it to his own fund of experiences and 
ideas. Interpretation also includes competence in recogniz- 
ing the essentials and differentiating them from the less 
essential portions or from the relatively irrelevant aspects 
of the communication. This requires some facility in ab- 
stracting generalizations from a set of particulars as well 
as in weighing and assessing the relative emphasis to be 
given the different elements in the communication. In these 
respects, interpretation becomes synonymous with analysis 
and has characteristics in common with evaluation. 


The essential behavior in interpretation is that when 
given a communication the student can identify and compre- 
hend the major ideas which are ingluded in it as well as 
understand their interrelationships. This requires a nice 
sense of judgmeht and caution to avoid reading into the docu- 
ment one's own ideas and interpretations. It also requires 
some ability to go beyond mere repetition and rephrasing of 
parts of the document to determine the larger and more gen- 
eral ideas contained in it. The interpreter must also recog- 
nize the limits within which interpretations can be drawn. 
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2.20 Interpretation--Illustrative educational objectives 


The ability to grasp the thought of a work as 
a whole at any desired level of generality. 


The ability to comprehend and interpret with 
increasing depth and clarity various types of 
reading material. 


The ability to distinguish among warranted, 
unwarranted, or contradicted conclusions drawn 
from a body of data. 


The ability to interpret various types of 
Social data. 


Ability in making proper qualifications when 
interpreting data. 
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2.30 Extrapolation 


In preparing a communication, the writer attempts not 
only to state what he believes the truth of the matter to be, 
but also some of the consequences of it. While occasionally 
the writer is exhaustive, has detailed all of the conclusions 
to be drawn, and has indicated all of the possible conse- 
quences or implications of his ideas or material, this is 
rarely the case. Usually, the writer is unaware of or makes 
no effort to determine or state all of the conclusions to be 
drawn. The writer is limited in determining implications 
and consequences for new situations by his subject matter, 
which may be so general and widely applicable as to make 
impossible any attempt to explain all its ramifications, by 
his own lack of knowledge of allthe possible situations in 
which it may be applied, and, finally, by the fact that he 
must in some ways limit his problem or presentations if he 
is to do an effective job. 


The reader must, if he is to make full use of a commu- 
nication, be able to extend it beyond the limits set by the 
writer as well as to apply some of the ideas of the commu- 
nication to situations and problems not included explicitly 
in the communication. Mention was made earlier of extra- 
polation in the sense of thinking in terms of the relations 
between a sample and a universe and vice versa, and also 
of interpolation as akin to extrapolation where there are 
gaps ina sequence. 


Accurate extrapolation requires that the reader be able 
to translate as well as interpret the document, and in addi- 
tion, he must be able to extend the trends or tendencies 
beyond the given data and findings of the document to deter- 
mine implications, consequences, corollaries, effects, etc., 
which are in accordance with the conditions as literally 
described in theeoriginal communication. Extrapolation 
requires that the reader be well aware of the limits within 
which the communication is posed as well as the possible 
limits within which it can be extended. In practically all 
cases, the reader must recognize that an extrapolation can 
only be an inference which has some degree of probability- - 
certainty with respect to extrapolations is rare. 
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Extrapolation as here defined is to be distinguished 
from application in that the thinking is characterized by the 
extension of that which is given to intermediate, past, future, 
or other conditions or situations. The thinking is usually 
less abstract than in the case of application where use is 
made of generalizations, rules of procedure, and the like. 


2.30 Extrapolation--Illustrative educational objectives 


The ability to deal with the conclusions of a work 
in terms of the immediate inferences made from 
the explicit statements. 


The ability to draw conclusions and state them ef- 
fectively. (Recognizing the limitations of the data, 
formulating accurate inferences and tenable hy- 
potheses.) 


Skill in predicting continuation of trends. 
Skill in interpolation where there are gaps in data. 


The ability to estimate or predict consequences of 
courses of action described in a communication. 


The ability to be sensitive to factors which may 
render predictions inaccurate, 


The ability to distinguish consequences which are 
only relatively probable from those for which 
there is a high degree of probability. 


The ability to differentiate value judgments from 
predictions of consequences. 
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TESTING FOR COMPREHENSION, AND 
ILLUSTRATIVE TEST ITEMS 


Testing for translation objectives. 


In appraising student ability totranslate technical terms, 
physics principles expressed in algebraic symbols, diagrams, 
or graphs by means of recall or recognition types of exer- 
cises, there may be clear-cut relationships between what is 
given and the response written or identified by the student. 
For example, terms may be listed and their definitions re- 
quested, or the definitions may be given and the student 
merely asked to recall or recognize the appropriate terms. 
In this situation the behaviors evaluated are equivalent to 
those listed under the category of knowledge, and this is 
particularly true where instruction has made explicit such 
formal associations. But these identical exercises may 
evaluate translation objectives which involve more than mere 
recall or recognition if instruction has been less formaland 
the thought processes of the student involve making new 
associations. For example, the answer to be selected as the 
definition of a term may be a definition which differs in 
phraseology from the formal one he has learned, and hence 
constitutes a novel situation. 


Student ability to translate formal definitions or state- 
ments of principles may also be evaluated by exercises re- 
quiring him to recall or recognize correct illustrations or 
examples. But exercises requiring the selection of the 
"best" definition of a term may require more than the asso- 
ciation of definition with term, if the student must judge the 
adequacy of the various definitions given. In still other 
types of exercises, more may be given than the terms or 
symbols and the student may have the advantage of contextual 
clues. Here again the nature of the previous instruction 
is the deciding factor rather than the appearance of the item. 
If the evaluation is to be of a behavior transcending knowl- 
edge, the context in which the terms or symbols appear must 
be to some extent novel context. 


Additional complexity at the translation level of behavior 
occurs in certain types of exercises where more than one 
new term or symbol occurs and the student, while success- 
ively translating the terms or symbols, will need to consider 
their interrelationships. Item 18 on page 104 is an example 
of this sort of evaluation. 
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Evaluation of objectives at higher levels in the taxonomy 
is often impaired because of the student's inability to perform 
the initial step in problem solution: the translation of the 
problem into known terms. For example, the effectiveness 
of exercises usedto evaluate application of general principles 
may be reduced because numerous students are unable to 
translate such terms as "Avogadro's principle, " "Doppler 
effect," and "Gresham's law." For effective measurement 
where knowledge of such terms is not universal, the concepts 
they represent must be given in simpler or less abstract 
phraseology. 


But even the simplest of demands given in either essay 
or objective exercises requires some translation for 
certain students. Experimentation has shown that some 
students are able to reduce or simplify the statement of 
the problem or to change it to language more characteristic 
of their own thinking without essentially changing the prob- 
lem. But many students are unable to do such translation 
and may so distort the problem that they no longer are at- 
tempting to solve the same problem.! Evidence with re- 
spect to translation difficulties of the kinds described above 
may be obtained through use of appropriately worded essay 
exercises requiring the student to record the various steps 
in his thinking or it may be more effectively obtained through 
use of "thinking aloud" techniques for studying mental pro- 
cesses. 


1 Bloom, B. S., and Broder, Lois, Problem-solving 
processes of college students (A Supplementary Educa - 
tional Monograph), Chicago: University of Chicago Press, 
Summer, 1950. 
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2.00 - COMPREHENSION -- ILLUSTRATIVE TEST ITEMS 


2.10 Translation from one level of abstraction to another. 


1, A group of examiners is engaged in the production of a taxonomy of 
educational objectives. In ordinary English, what are these persons 
doing? 

A- Evaluating the progress of education 
B- Classifying teaching goals 

C- Preparing a curriculum 

D- Constructing learning exercises 


This exercise involves translation of "taxonomy" to "classification, " 
a less abstract term. There is no context clue. 


2. "The idea systems of primitive groups of peopleare highly restricted 
and traditional in content and, in addition, have been transmuted 
into customary ways of doing things." This best illustrates 

A- the stability of the primitive social organization. 
B- how primitive people evaluate the worth of ideas. 
C- the change of ideas to action. 

D- the repetition of customary ways of doing things. 
E- the slow progress of primitive peoples. 


This requires translation of the term "transmuted" to the less ab- 
Stract word "change" and here translation is aided by context clues. 


3. When a current is induced by the relative motion of a conductor and 
a magnetic field, the direction of the induced current is such as to 
establish a magnetic field that opposes the motion. This principle 
is illustrated by 


A- a magnet attracting a nail. 

B- an electric generator or dynamo. 
C- the motion of a compass needle. 
D- an electric doorbell. 


This involves translation of a formal and abstract definition by re- 
quiring the student to identify a concrete example. 
LJ 

4. While listening to lectures in physical science you have heard the 
following terms ffequently used: "hypotheses," "theories," "sci- 
entific laws," "scientific method," and "scientific attitude." In a 
Series of paragraphs, indicate in your own words and in terms of 
everyday experiences what these terms mean to you. 


This exercise, an essay question, also involves the giving of con- 
crete examples and also the behavior of "giving in your own words." 
Whether more than knowledge is required for the third and fourth ex- 
ercises depends on previous instruction. 
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5. Which of the following represents the best definition of the term 
"protoplasm"? 

A- A complex colloidal system made up of water, proteins, and 
fats. 

B- Anything capable of growth by a regular progressive series of 
changes into a more complex unit. 

C- A complex mixture of proteins, fats, and carbohydrates, ca- 
pable of responding to changes in its environment. 

D- A complex colloidal system of proteins, fats, carbohydrates, 
inorganic salts, and enzymes which manifests life. 


This exercise requires judgment of the best definition of the term 
"protoplasm." The definitions given vary in correctness and com- 
pleteness. 


6. "Allideas are products of experience, or of reflection on experi- 
ence. Sensations when given meaning are perceptions, Association 
of perceptions, or of simple ideas, leads to complex or abstract 
conceptions whose original source is still experience. " This quo- 
tation best represents the point of view of 

A- positivism. 
B- rationalism. 
C- idealism. 

D- empiricism. 
E- pragmatism. 


This requires the student to translate a concrete description of a 
type of philosophy to the abstract technical term standing for the 
type. This could involve mere recall, but may require more than 
recall if instruction has been characterized by no such brief sum- 
marization of the nature of empiricism, 


7. When a beggar justifies his begging by the claim that the world owes 
him a living, he is 
A- behaving like a psychotic person, 
B- showing a paranoid symptom. 
C- having an hallucination. 
D- making a typical infantile reaction. 
E- rationalizing. 


In this exercise a concrete example is given and the student required 
to identify the correct abstract term. More than:knowledge is re- 
quired if the example is new to the students. 
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2.10 Translation from symbolic form to another form, or vice versa 


as 


| 


EE 


ime] 
a. 


| 


l 


Cà 


--after Darling 


8. This cartoon best illustrates: 
A- Social problems are relative to time, place, and culture. 
B- The process of inventions is cumulative. 
C- Social problems are more prevalent in a dynamic society. 
D- There are differences in the rates of change between differ- 
ent phases of a culture. * 


LJ 
9. The concept illustrated by the cartoon is 


A- technological progress. 

B- cultural lag. 

C- cultural diffusion. 

D- institutional maladjustment. 
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10, Newton's Law of Gravitation is expressed algebraically F = at. 
F represents force, M and m two masses, G is a constant, and d 
represents the distance between the masses. Assuming that M 
and m, as well as G, remain the same, or constant, which of the 
following graphs shows how the force changes as the distance be- 


tween the masses varies? 
F F 
A. B. 
d ad 
ES F 
c. D. 
3 a 
The exercise presented above illustrates translation from algebraic 


to geometric or graphic form. The exercises which follow involve 
translation from graphic to verbal form. 
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11, Which of the following graphs best represents the demand schedule 
of a typical commodity under competitive conditions ? 


A B. C D 
D 
f3 
aD Dod & & 
D D 
uantity antity antity antity 


12, Which of the above graphs best represents the demand schedule of 
a commodity for which there is a perfectly inelastic demand? 


13. Which of the following graphs best represents the supply schedule 
of a commodity under conditions of perfect competition? 


A. B. ro : D. 
9 oS 9 S 9 S 
=| z 3 S 
R 
aS ps Ey & 
S S 
Quantity Quantity Quantity Quantity 


14. Which of the above graphs best represents the supply situation 
where a monopolist maintains a uniform price regardless of the 
amounts which people buy? 

T'he following five formulas represent the structure of five different or- 

ganic compounds. After the item number on the answer sheet, blacken 

the one lettered space which designates the compound to which each item 
correctly refers. 


HHHH HH HHH HH HH HO 
BGGCCH H¢GOH HGC¢GCH HOC-CCH HÇ-CÍ 
HAHH HH HI H H ‘OH 
F-C-H 
H 
A B [en o D E 


15. The compound which can neutralize bases and forms salts. 


16. The hydrocarbon which has the least tendency to "knock" among 
those listed above. 


17. The compound which decolorizes bromine and potassium perman- 
ganate solution. 


Note: While each of the formulas pertains to a specific organic com- 
pound, each of the compounds is representative of a type or class 
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of compounds. The compound labeled B is but one of numerous alco- 
hols. Hence each formula serves to symbolize a type. A student 
may say to himself with respect to D, "The double bond between two 
adjacent carbon atoms shows that this is an unsaturated compound. 
All such compounds react with bromine or potassium permanganate 
decolorizing them. Hence, the answer to'l7 is D." Giving meaning 
to the double bond -C=C- is to translate the symbol for such a 
O 
union of carbon atoms. Similarly, -cf signifies an organic acid 
OH 
and leads to the conclusion that such a compound will neutralize a 
base and form a salt. 


18. Coulomb's Law of Electrostatic Attraction states: "The force of 
attraction or repulsion between two charged bodies is directly pro- 
portional to the product of the charges, and inversely proportional 
to the square of the distance between them." If F is force, Q and 
Q' are charges, D is the dielectric constant and d is distance, a 
mathematical statement of the law is 


Ace Pa S B- F= QQ' c- F= QQ' 
Da? D?d Dd? 
2 
De De-Q-. E- d= QQ 
Fd DF 


Note: If the student has memorized the equation given as answer C, 
mere recall is sufficient in selecting the correct answer. The cor- 
rect answer can be obtained, however, through translation of the 
verbal statement to mathematical symbols. 


2.10 Translation from one verbal form into another verbal form 


19. "Milton! thou shouldst be living at this hour: England hath need of 
thee; she is a fen of stagnant waters" --Wordsworth. 


The metaphor, "she is a fen of stagnant waters, " indicates that 
Wordsworth felt that England was 
A- largely swampy land. 
B- ina state of turmoil and unrest. 
C- making no progress. 
D- ina generally corrupt condition. 
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When I consider everything that grows 
Holds in perfection but a little moment, 
That this huge stage presenteth nought but shows 
Whereon the stars in secret influence comment; 
When I perceive that men as plants increase, 
Cheered and checked even by the self-same sky; 
Vaunt in their youthful sap, at height decrease, 
And wear their brave state out of memory; 
Then the conceit of this inconstant stay 
Sets you most rich in youth before my sight, 
Where wasteful Time debateth with Decay, 
To change your day of youth to sullied night; 
And all in war with Time for love of you, 
As he takes from you, I engraft you new. 
(Shakespeare, Sonnet XV) 
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20. In the first two lines Shakespeare says that 


A- all living things are examples of the perfection of nature. 

B- every living thing retains perfection only for a very brief time, 
C- man, part of all living things, is basically not perfect. 

D- allliving things show the characteristics of evolution, 


21, In lines 3 and 4, the poet says that 


A- life, which is subject to the laws of nature, is ephemeral and 
transitory, like a play. 

B- allthe world's a stage, whose lighting is given by the stars. 

C- man, a character in a great drama, is controlled by the 
"stars," that is, destiny. 

D- the stage of the universe is controlled by the laws of nature. 


Note: The original series included three more exercises relevant to 
other lines in the sonnet. Here the student is expected to make use 
of the context in order to determine the appropriate translation. 


22. Das Gut gehórt immer noch dem Grossvater: 


A- Grandfather still hears well. 

B- Grandfather always hears good things. 

C- The estate still belongs to grandfather, 

D- The good people always listen to grafdfather. 
E- The goods still belong to grandfather. 


Note: The student is expected to select the English sentence which 
represents the best translation of the German sentence. Similar ex- 
ercises may be written with an English sentence as the item stem 
and German sentences as the answers. The same type of exercise 
could be extended to the use of brief paragraphs as item stems and 
as answers, In every case, as is true of answer C of exercise 22, 
the best answer should be more than a literal translation. 
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Testing for interpretation objectives, and illustrative test 


items 


In evaluating the ability to interpret, the individual is 
presented with a communication and is asked to supply or 
recognize inferences which may be drawn from the commu- 
nication. The inferences may be at a more general level 
than the communication itself and should, where possible, be 
based on more than one element in the communication. Some- 
times, the inferences may represent generalizations based 
on particulars given in the communication, or may pertain 
to particulars to which generalizations given in the commu- 
nication apply. 


Essay exercises can be used in the evaluation of student 
ability to interpret. The essay exercise should accompany 
the communication to be interpreted and this communication 
may be one or more quoted paragraphs, a cartoon, a graph, 
or a table of numerical data. For example, a student may 
be asked to compare or contrast the points of view of Hamil- 
ton and Jefferson with respect to the powers of the National 
Government given quotations from The Federalist and from 
the Second Inaugural. The interpretation of a lengthy quota- 
tion may be that of preparing a summary or outline. One or 
more cartoons may be the basis for an essay exercise re- 
quiring the student to interpret the cartoons with respect to 
some contemporary social problem or issue. Similarly, 
graphs or tables with appropriately worded essay questions 
may require the student to interpret the data thus presented 
and to draw inferences from them respecting their interrela- 
tionship or meaning as a whole. 


Objective exercises can also be used in the evaluation of 
interpretation ability. Thus, the exercises which follow the 
quoted paragraphs, cartoons, tables, or graphs may either 
be any of the more usual objective types, for example, the 
multiple choice, or students may be asked to classify items 
relevant to the quoted material according to certain cate- 
gories. As an example of the latter, if two selections are 
given, the student may be asked to classify items as "true of 
the first selection, " "true of the second selection," "true of 
both selections," and "true of neither selection." The items 
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may be inferences which correctly pertain to interrelation- 
ships in either or both of the selections or they may be in- 
correct inferences or generalizations. A second example 
employs a very useful type of direction, particularly where 
the quoted material in paragraph form presents scientific 
data, or such data are presented in tabular or graphic form. 
It requests the student to classify items according to whether 
or not the data are sufficient to prove the truth or falsity of 
the items or are insufficient for such judgments. Frequently, 
the categories ask the students to judge each item with 
respect to whether the given data definitely support its truth, 
indicate that the item is probably true, definitely reveal that 
it is false, indicate that it is probably false, or whether the 
data are insufficient for any judgment with respect to the 
truth or falsity of the item. These categories may be ordered 
in the form of a scale: (1) definitely true, (2) probably 
true, (3) insufficient evidence, (4) probably false, (5) defi- 
nitely false. 


Test scores differentiating between "crude errors," ''go- 
ing beyond the data," and "over-caution" are especially use- 
ful in evaluating student skill in interpretation since such 
scores may be relatively independent of knowledge of content 
and may be valid measures of modes of operation and gener- 
alized techniques for dealing with materials and problems. 
If the categories are in the order suggested at the. c lose of 
the preceding paragraph, "going beyond the data," or the 
tendency to over-generalize may be evaluated by counting 
incorrect answers which are in the direction of the extremes 
of the scale. Over-caution is evaluated by counting incorrect 
answers which are in the direction of the center of the scale. 
The tendency to make "crude errors" is evaluated by count- 
ing incorrect answers which traverse the center of the scale. 


——————— 
? Use of this type of item, however, should be limited 


to instances in which the student is given some pre-test 
training in the proper use of these terms. Otherwise, the 
tendency to use "probably true" or "probably false" to ex- 
press the student's doubt about his own answer, as opposed 
to doubt about the data's completeness, tends to obscure 
proper interpretation of the results. 
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(See the notes which follow the first of the illustrative series 
of the exercises of this type.) Exercises of the type just de- 
scribed usually ask the student to make his judgments or in- 
terpretations only on the basis of the data given. Occasion- 
ally, the student is asked to evaluate the truth or falsity of 
items in terms of both the given data and in terms of what- 
ever other knowledge he possesses. Items 49-58 of the il- 
lustrative exercises given on the following pages permit 

the use of other knowledge in the interpretation of the data 
given. 


2.20 Interpretation 109 


Consumers! Price Index, 1918-49 
(1935 - 39 = 100) 


Per Cent 


Source: U.S. Dept. of Labor, 
Bureau of Labor Statistics 


Making your judgments only in terms of the information given in the 
graph, classify each of the following items by blackening space 


A- ifthe item is definitely true; 

B- ifthe item is probably true; 4 

C- if the information given is not sufficient to indicate any 
degree of truth or falsity in the item; 

D- ifthe item is probably false; 

E- ifthe item is definitely false. 


23. People were better off in 1932 than in 1949. 

24, Since 1918 to the present, the dollar was most valuable in 1933. 

25. More prices went up than went down between 1932 and 1940. 

26. Men in the age group of 30-40 made the most income gains in the 
past decade. 

27. In 1940-46 some loss in real income was most probably incurred 
by people living on interest from bonds. 

28. More prices wegt down than went up between 1926 and 1929. 

29. Anyone living on a fixed income was much worse off in 1949 than 
in 1940. 


Note: "Going beyond the data" requires a count of B items marked 
A, C items marked A, B, D, or E, and D items marked E. "Over- 
caution" requires a count of A items marked B, B and D items 
marked C, and E items marked D. Evaluation of "crude errors" re- 
quires a count of A and B items marked D or E and D or E items 
marked A or«B. 
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DIRECTIONS: Below are some statistics relating to education and oc- 
cupations, You are to judge what conclusions may be drawn from them, 


Occupational distri- 

bution found in a Distribution of occupa- 
sample of male tions in the population 
college graduates* as a whole, 1950 


OCCUPATIONS PERCENTAGES 


Executives, minor officials, 23.5 9.1 
partners, proprietors 


Professional workers 51.3 4.7 
Salesmen 6.0 Less than 1% 
Skilled workers VES: 33.8 
Clerical workers 8.7 13.4 
Unskilled workers Lat 26.1 
Farmers Ut 13.0 
100.0 100.0 


*You may assume that the sample selected is representative of 
all male college graduates in the United States. 


Below are a series of statements relating to occupations and education. 
Blacken answer space 


A- if the foregoing statistics alone are sufficient to prove the 
statement true; 

B- if the foregoing statistics alone are sufficient to indicate that 
the statement is probably true; 

C- if the foregoing statistics alone are not sufficient to indicate 
whether there is any degree of truth or falsity in the statement; 

D- if the foregoing statistics alone are sufficient to indicate that 
the statement is probably false; 


E- if the foregoing statistics alone are sufficient to prove the 
statement false. 


30, Typically farmers are completely uneducated. 


31. The professions absorb a larger percentage of male college gradu- 
ates than any other group in the country. 


32. Sons of unskilled workers and sons of farmers have an approxi- 
mately equal chance to go to college. 


33. Educational opportunity for the lower classes is increasing. 


34. The same proportions of farmers and of unskilled workers are 
college graduates. 
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DIRECTIONS: The following generalizations are sometimes inferred 
from the foregoing statistics on occupations and education, You are to 
judge whether or not the generalizations made below can be made on 
the basis of these data alone or if certain additional data are needed, 
For the following items, blacken answer space 


A- if the generalization can be made on the basis of the foregoing 
statistics, without any additional information. 

B- if in addition to or instead of the foregoing statistics you would 
need to know the percentage of people in each occupation who 
were unable to attend college. 

C- if in addition to or instead of the foregoing statistics you would 
need to know the percentage of male college graduates in each 
occupation whose fathers were college graduates and were in 
the same occupation. 

D- if the generalization cannot properly be made even if the addi- 
tional information described in B and C were available. 


35. Unskilled, skilled and clerical workers do not value college edu- 
cation as much as do businessmen, 


36. The low percentage of college graduates in the skilled, clerical, 
and unskilled worker class reveals a lack of social mobility in 
America. 


37. Higher education provides a medium in this country whereby 
Some youth improve their status. 


38. Children of business and professional men have a greater oppor- 
tunity to enter well-paid occupations. 


39. Social mobility in the United States is increasing. 


A scientist cultivated a large colony of disease-producing bacteria. 
From them, he extracted a bacteria-free material referred to as sub- 
Stance X. A large dose of substance X was then injected into each ofa 
group of animals (group A). These animals promptly developed some 
of the symptoms normally produced in infection by the bacteria in ques- 
tion. Then, into each of a number of other animals (group B), the sci- 
entist made a series of injections of small ddses of substance X. Three 
weeks after this series of injections, “and continuing for two years there- 
after, this group of ‘Animals (group B) could be made to develop the dis- 
ease by injecting them with several thousand times the number of bac- 
teria which was fatal to untreated animals. 


After the item number on the answer sheet, blacken space 


A- if the data given above definitely show that the item correctly 
completes the introductory statement. 
B- if the data given above do not definitely show that the item 
correctly completes the introductory statement. 
(Be careful to make your judgments in terms of the 
data given in the description of the experiment.) 
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Substance X acted upon the animals of group A as if it were a 


40. poison. 

41. destroyer of poisons. 

42. stimulator causing animals of group A to produce destroyers of 
the bacterial poison. 


With reference to its effect upon the animals of group B, substance X 
appeared to act as 


43. a means of counteracting the effects of the disease-producing 
bacteria. 

44. ifit were a destroyer of the bacteria or of their poisonous 
products. 

45. if it were a poisonous product of the bacteria. 


Ten months after the series of injections described above, the scientist 
prepared serum from the blood of the animals of group B. He injected 
this serum into each of a large group (group C) of animals infected with 
the disease. A control group, also infected with the disease, was given 
no serum. There was a higher percentage of prompt recoveries in 
group C than in the control group. 


Serum from the animals of group B acted in the animals of group C to 


46, stimulate the animals of group C to produce a destroyer of the 
disease-producing bacteria or their poisonous products. 

47, destroy the disease-producing bacteria or their poisonous prod- 
ucts. 

48. hasten the deleterious effects of the disease-producing bacteria 
upon animals of group C. 
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"Supply and demand are determined in large part by the marginal 
consumers and marginal producers. If a tax is levied only on nonmar- 
ginal producers it does not materially increase the costs of production 
of the marginal producers, and does not, therefore, greatly influence 
the price to the public. In other words, the tax in such a case cannot 
readily be shifted. A tax on net income is such a tax. Those who have 
no net income are not taxed and their costs of production are not in- 
creased. They continue to produce at no increase in costs. It is their 
costs that determine primarily the price of the product. Those who pay 
the tax on net income, being nonmarginal producers, find it impossible 
or exceedingly difficult to pass the tax on to the consumers in the form 
of higher prices. 


"A sales tax, on the other hand, does raise the costs of production 
of the marginal producers, causing them to withdraw from production 
unless the tax can be shifted in the form of higher prices to the con- 
sumer. If some withdraw from production, the supply will decrease 


and the price will increase sufficiently to absorb the sales tax. " 
--Quoted from Introduction to Social Science 


by Atteberry, Auble, Hunt, and others. 


After the item number on the answer sheet, blacken space 


A- ifthe item is true and its truth is. supported by information 
given in the paragraph. 

B- ifthe item is true, but its truth is not supported by information 
given in the paragraph. 

C- ifthe item is false and its falsity is supported by information 
given in the paragraph. 

D- if the item is false, but its falsity is not supported by informa- 
tion given in the paragraph. 


49. Marginal producers are less affected by a sales tax than by an 
income tax. 


50, Nonmarginal producers find it difficult to pass a tax on net income 
on to the consumer in the form of higher prices, because consum- 
ers will then buy largely from marginal producers. 


51. An income tax has less effect on prices than a sales tax. 

52, Taxes on luxuries can be more readily Sue to the consumer 
than taxes on necessities. 

53. The two paragraphs assume conditions of free competition. 

54, Marginal producers pay no tax on net income. 


55. Nonmarginal producers can pass a sales tax to consumers in the 
form of higher prices, because the marginal producers must also 
raise prices or withdraw from competition. 

56. A decrease in price has the same effect on marginal consumers 
that it has on marginal producers. 
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An anthropologist wishes to discover whether there are intelligence dif- 
ferences between white people and Negroes. He administers a standard 
group intelligence test to all of the students in alternate grades of a 
small town school system which includes a public junior college. His 
results are presented in the following table: 


White students Negro students 
Grade No. taking test Ave. 1.Q. No. taking test Ave. I. Q. 
1 300 103 75 85 
3 275 99 60 90 
5 260 101 35 105 
7 240 108 20 115 
H.S. Soph. 215 115 10 125 
H.S. Senior 200 120 8 135 
J.C. 2nd yr. 100 125 3 145 


On the basis of the data in this table the anthropologist formulates a 
number of conclusions. Some of these are given below, together with 
possible comments which might have been made by consulting scientists 
called in to evaluate his work. For each of these numbered conclusions, 
blacken the answer space corresponding to the one comment which might 
appropriately be made in such an evaluation. 


57. Some Negroes are more intelligent than most people. 

A- This conclusion is valid. 

B- This is probably true, but one cannot be sure, because the 
Negroes included in the study are a selected group. 

C- This is probably true, but one cannot be sure, because both 
Negroes and whites included in the study are a Selected group. 

D- This is probably untrue, since the average I.Q. for lst grade 
Negroes is 18 points lower than for 1st grade whites. 

E- The comparison is valid only if there are no real qualitative 
differences between the white and Negro mind. 


58. Before beginning schooling, Negro children in this community are 
less intelligent than white children. 


A- This conclusion is valid. 

B- This conclusion is valid, provided the children who enter first 
grade are typical of the children of each race. 

C- This conclusion żs valid provided the children who enter first 
grade are typical of the children of each race, and provided 
the items on the test do not really measure skills which white 
children have a better chance to learn. 

D- This conclusion is valid, provided the children who enter first 
grade are typical of the children of each race, and provided 
some Negroes were included in the group originally used in 
standardizing the test. 


Note: The original series included seven more exercises relevant to the 
data given above. 
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59. 

The first paragraph below is quoted from an inaugural address by 
Thomas Jefferson; the second paragraph is taken from one ofthe essays 
in The Federalist, written by Alexander Hamilton. Read these quota- 
tions for the purpose of identifying the major controversial issue inher- 
ent in them. Then write a brief essay in which you indicate the current 
importance and implications of this issue. 


I 


"About to enter, fellow-citizens, on the exercise of duties which com- 
prehend everything dear and valuable to you, it is proper you should 
understand what I deem the essential principles of our Government, and 
consequently those which ought to shape its Administration. I will com- 
press them within the narrowest compass they will bear, stating the 
general principle, but not all its limitations. Equal and exact justice 
to all men, of whatever state or persuasion, religious or political; 
peace, commerce, and honest friendship with all nations, entangling 
alliances with none; the support of the State governments in all their 
rights, as the most competent administrations for our domestic con- 
cerns and the surest bulwarks against anti-republican tendencies; the 
preservation of the General Government in its whole constitutional 
vigor, as the sheet anchor of our peace at home and safety abroad; a 
jealous care of the right of election by the people--a mild and safe cor- 
rective of abuses which are lopped by the sword of revolution where 
peaceable remedies are unprovided; absolute acquiescence in the deci- 
Sions of the majority, the vital principle of republics, from which is no 
appeal but to force, the vital principle and immediate parent of despot- 
ism; a well-disciplined militia, our best reliance in peace and for the 
first moments of war, till regulars may relieve them; the supremacy 
of the civil over the military authority; economy in the public expense, 
that labor may be lightly burthened; the honest payment of our debts 
and sacred preservation of the public faith; encouragement of agricul- 
ture, and of commerce as its handmaid; the diffusion of information 
and arraignment of all abuses at the bar of the public reason; freedom 
of the press; the freedom of person under the protection of the habeas 
corpus, and trial by juries impartially selected. These principles 
form the bright constellation which has gone before us and guided our 
Steps through an age of revolution and reformation," 


II e 


"The result of these,observations to an intelligent mind must be clearly 
this, that if it be possible at any rate to construct a federal government 
capable of regulating the common concerns, and preserving the general 
tranquillity, it must be founded, as to the objects committed to its care, 
upon the reverse of the principle contended for by the opponents of the 
Proposed constitution, It must carry its agency to the persons of the 

citizens. It must stand in need of no intermediate legislations; but must 
itself be empowered to employ the arm of the ordinary magistrate to 
execute its own resolutions. The majesty of the national authority must 
be manifested through the medium of the courts of justice. The govern- 
ment of the union, like that of each state, must be able to address itself 
immediately to the hopes and fears of individuals; and to attract to its 
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support those passions which have the strongest influence upon the 
human heart. It must, in short, possess all the means, and have a 
right to resort to all the methods, of executing the powers with which 
it is entrusted, that are possessed and exercised by the governments 
of the particular states." 

60. 

The following selection from the writings of Descartes contains his 
explanations of certain phenomena. State which of his explanations are 
still accepted as valid, and indicate which of his explanations are no 
longer accepted, pointing out briefly how they have been modified. 


"Those who have acquired even the minimum of medical knowledge 
know how the heart is composed, and how all the blood in the veins can 
easily flow from the vena cava into its right side and from thence into 
the lung by the vessel we term the arterial vein, and then return from 
the lung into the left side of the heart, by the vessel called the venous 
artery, and finally pass from there into the great artery, whose branches 
spread throughout all the body .... We know that all movements of 
the muscles, as also all the senses, depend on the nerves, which re- 
semble small filaments, or little tubes, which all proceed from the 
brain, and thus containlike it a certain very subtle air or wind which 
is called the animal spirits....So long as we live there is a continual 
heat in our heart, which is a species of fire which the blood of the veins 
there maintains, and this fire is the corporeal principle of all the move- 
ments of our members. ... Its first effect is to dilate (expand) the blood 
with which the cavities of the heart are filled; that causes this blood, 
which requires a greater space for its occupation, to pass into the great 
artery; then when this dilation (expansion) ceases, new blood immedi- 
ately enters from the vena cava into the right cavity of the heart, and 
from the venous artery into the left cavity. . . . The new blood which has 
entered into the heart is then immediately afterward rarefied (expanded) 
in the same manner as that which preceded it; and it is just this which 
causes the pulse, or beating of the heart and arteries; so that this beat- 
ing repeats itself as often as the new blood enters the heart. It is also 
just this which gives its motion to the blood, and causes it to flow 
ceaselessly and very quickly in all the arteries and veins, whereby 
it carries the heat which it acquires in the heart to all parts of the 
body, and supplies them with nourishment. " 


61, "umi 
The cartoon strip reproduced below portrays an episode in the life of 
Andy Gump. Write a paragraph in which you tell how you as a physi- 


ologist would explain Andy's reaction to the presence of the bear. 


THE GUMPS EARING UP 
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Testing for extrapolation objectives, and illustrative test 
items 


It is often effective to test for extrapolation while testing 
ability to interpret through use of essay or objective exer- 
cises of the type earlier described and illustrated. The ex- 
ercises on extrapolation then attempt to determine whether 
or not the student can go beyond the limits of the data or in- 
formation given and make correct applications and exten- 
sions of the data or information. It is to be expected that 
the extrapolations will differ from the original in some of 
the following respects: 


A. Time dimension--if the data given contain trends 
and tendencies within a given time range, the ex- 
trapolation will represent an attempt to extend the 
trends and tendencies to other time periods (includ- 
ing time periods within a sequence). 


B. Topic or domain--if the communication deals with 
one topic or subject, the extrapolation may repre- 
sent an attempt to extend the ideas to another topic 
or situation which is relevant. This is more than 
altering the form of the communication, since it 
involves extending the ideas beyond the original 
topic or subject. 


C. Sample or universe--if the data deal with a sample, 
the extrapolation may pertain to the universe from 
which the sample is drawn. Conversely, if the 
data pertain to a universe, the extrapolation may 
pertain to a sample. For example, data may be 
given with respect to the trends in production of 
automobiles over a period of years, while the ex- 
trapolafion may pertain to the production of Ford 
cars. 
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2.30 Extrapolation 


In the chart given below, amounts spent for any given state function all 
read from the base line. For example, interest and retirement of the 

state debt required the expenditure of 40 million dollars in 1938, rather 
than 40 million minus 21. 


Total Expenditures 
State of Illinois 


Million Dollars 


0 
29 30 31 32 33 = 35 37 37 38 39 40 
Fiscal Years ending June 30 


After the number on the answer sheet corresponding to that of each 
statement, blacken space 

if the information given in the chart is sufficient for a 
judgment that the statement is definitely true. 

if the information given in the chart is sufficient only to 
indicate that the statement is probably true. 

if the information given in the chart is not sufficient to 
indicate any degree of truth or falsity in the statement. 
if the information given in the chart is sufficient for a 
judgment that the statement is probably false. 

if the information given in the chart is sufficient for a 
judgment that the statement is definitely false. 


Io la lw I» 


|t 


62, Less money was spent in 1930 than before 1929 for. welfare and 
education, 

63, In 1931 and 1932 the expenditure of money for highway purposes was 
evidently considered a means of combatting the depression. 

64, Had our country not entered the war in 1941, expenditures for wel- 
fare in 1942 would have been greater than in 1940, 

65. In 1940 a much greater proportion of the total expenditures were 
for welfare than in 1942. 

66, The increasing amount of money spent by the State for all purposes 
between 1929 and 1940 must have come from sources other than 
borrowing. 
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67, Less money was spent by the State in 1930 than in 1929 almost 
wholly because of retrenchment with respect to highway expen- 
ditures. 

68, Less money was spent for highways in 1931 than in 1932. 

69, Unemployment increased in the State between 1937 and 1939, 

70. Increase in expenditures from 1929 to 1940 has been the least in 
those classified under interest and retirement of State debt. 

71. The per capita expenditures of Illinois cities for welfare and for 
education parallel the State expenditures for these two purposes. 

72, The total expenditures of the State in 1940 exceeded one-half 
billion dollars. 

73, The State debt increased little between 1933 and 1940 as compared 
to expenditures for education. 


This is an example in which translation, interpretation, and extrapola- 
tion are all included. Items 62, 64, 65, 69, and 7] are examples of 
extrapolation, Item 71 is an example of extrapolating from universe to 
sample, 


74, Contrast the kinds of interpretation one can make from frequency 
polygons or histograms and smoothed curves drawn from the same 
distribution of test scores obtained from a sample of eighth grade 
pupils. 


75, The ratios of employed persons to unemployed are given for each 
year over an interval of several years. Why is such data inade- 
quate in revealing the employment status of auto-workers, lumber- 
men, harvest hands, and calendar salesmen? 


76, Immigrants tend to settle in the slum areas closest to the central 
business districts of our large cities. Where are their descend- 
ants most likely to be found? 


3.00 APPLICATION 


The whole cognitive domain of the taxonomy is ar- 
ranged in a hierarchy, that is, each classification within 
it demands the skills and abilities which are lower in the 
classification order. The application category follows this 
rule in that to apply something requires "Comprehension" 
of the method, theory, principle, or abstraction applied. 
Teachers frequently say, "If a student really comprehends 
something, then he can apply it." To make the distinction 
between the "Comprehension" and "Application" categories 
clear, we have described it in two ways. 


One way of looking at the distinction is this. A prob- 
lem in the comprehension category requires the student to 
know an abstraction wellenough that he can correctly dem- 
onstrate its use when specifically asked to do so. 'Appli- 
cation," however, requires a step beyond this. Given a 
problem new to the student, he will apply the appropriate 
abstraction without having to be prompted as to which ab- 
Straction is correct or without having to be shown how to 
use it in that situation. A demonstration of "Comprehen- 
sion" shows that the student can use the abstraction when 
its use is specified. A demonstration of "Application" 
Shows that he will use it correctly, given an appropriate 
Situation in which no mode of solution is specified. 


A second way of looking at this is demonstrated in 
Figure I. It shows in diagrammatic form the problem- 
solving process of answering questions classified in the 
"Application" category. In the complete solution of an "Ap- 
plication" problem, all 6 steps are involved. Whether the 
process more closely resembles the left or right side of the 
chain at steps 1 and 2 would depend upon the student's fami- 
liarity with the problem. Steps 1 through 4 are part of "Ap- 
plication" but not of "Comprehension." Comprehension is 
best represented by a problem which starts with step 5, 
Steps 1-4 being unnecessary because of the structuring of 
the problem situation. 
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Problem presented 


Perceived by 
student as 


Initially unfamiliar; Immediately having 
Step 1 student searches for familiar aspects to 
familiar elements guide actions 


Some restructuring by 
student to make resem- 
blance to familiar mod- 
el more complete 


Student uses familiar 
elements to restruc- 
ture problem in a fa- 
miliar context 


Step 2 


Classification of 
problem as familiar 
in type 


Step 3 


Selection of abstrac- 
tion (theory, princi- 
ple, idea, method) 
suitable to problem 
type 


Step 4 


Use of abstraction to 
solve problem 
g 
Solution to problem 


Step 5 


Step 6 


Figure I 


122 


The Educational Implications of Objectives in the Appli- 
tion Category 


The fact that most of what we learn is intended for ap- 
lication to problem situations in real life is indicative of 
the importance of application objectives in the general cur- 
riculum. The effectiveness of a large part of the School 
program is therefore dependent upon how well the students 
carry over into situations applications which the students 
never faced in the learning process. Those of you familiar 
with educational psychology will quickly recognize this as 
the age-old problem of transfer of training. Research 
studies have shown that comprehending an abstraction does 
not certify that the individual will be able to apply it cor- 
rectly. Students apparently also need practice in restruc- 
turing and classifying situations so that the correct abstrac- 
tion applies (steps 1-4 of Figure I). 


For instance, Horrocks and Troyer constructed a test 
which measured knowledge of fact and principle about ado- 
lescent development and three case study tests which mea- 
sured the ability to apply the facts and principles of adoles- 
cent development. The correlations between the tests of 
knowledge and application (over 100 students) ranged from 
.31 to .54 after they were corrected for attenuation, that 
is, corrected for the chance errors which affected the re- 
liability of tests used. Obviously, in this instance at least, 
possession of knowledge and the ability to apply it are not 
synonymous. | 


Many other studies in this area can be found. The gen- 
eral consensus seems to be that training will transfer to 
new areas most readily if the person is taught in such a way 
that he learns good methods of attacking problems, if he 
learns concepts and generalizations (rather: than how to use 
certain facts in specific instances), if helearns proper at- 
titudes toward work, and if he develops proper attitudes of 
self-confidence and control. It is obvious that the objectives in 
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John E. Horrocks, "The Relationship between Knowledge 
of Human Development and the Use of Such Knowledge, P 
Journal of Applied Psychology, 30, (1946), 501-507. 
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the application category, as they embody the meaning of 
transfer of training, are extremely important aspects of the 
curriculum, Further, the evaluation of the extent to which 
the application outcomes are being achieved becomes one of 
the most important aspects of the entire evaluation process. 
For, to the extent that the evaluation process gives the 
schools information concerning success or failure in this 
aspect of the curriculum, evaluation provides a feedback 
for future curricular revision. Such feedback is of the ut- 
most importance as a basis for appropriate revision of the 
educational process, 
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3.00 Application -- Illustrative Educational Objectives 


Looking over collections of teachers! objectives leads 
to the generalization that objectives in the application area 
sound very much alike, regardless of the subject matter 
involved, For this reason only a few examples are given 
below, No examples are given from the humanities field 
since the only examples that could be found used application 
of a principle as only a part (often minor) of a process, 
e.g., as in creating a piece of artwork (synthesis) or judg- 
ing a piece of artwork (evaluation). 


Application to the phenomena discussed by a paper, of 
the scientific terms and concepts used in other papers. 


The ability to apply social science generalizations and 
conclusions to actual social problems. 


The ability to predict the probable effect of a change in 
a factor on a biological situation previously at equili- 
brium, 


The ability to apply science principles, postulates, 
theorems, or other abstractions to new situations. 


Employing experimental procedures in finding the 
solutions to problems and the answers to questions in 
making home repairs, 


Apply principles of psychology in identifying the char- 
acteristics of a new social situation. 


The ability to relate principles of civil liberties and 
civil rights to current events. 


Skill in applying principles of democratic group action 
to participation in group and social situations. 


The ability to apply the laws of trigonometry to 
practical situations. 


To develop some skill in applying Mendel's laws of 
inheritance to experimental findings on plant genetic 
problems, 
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Testing for Application, and illustrative test items 


Experience in testing for application behavior has 
shown that several factors must be routinely taken into 
consideration, Some of them are as follows: 


Need for new yet real items 


If the situations described by the objective or by the 
testing situation are to involve application as we are defin- 
ing it here, then they must either be situations new to the 
student or situations containing new elements as compared 
to the situation in which the abstraction was learned. If 
the situations presented the student to test "application" 
are old ones in which he originally learned the meaning of 
the abstraction, the student does not have to "apply" the 
abstraction. Rather, he needs merely to recall the original 
situation in which he learned the abstraction, a behavior 
herein classified as knowledge or a level in comprehension. 
This is likely to mean that the problem must either (a) be 
posed in a situation which is fictional, (b) be one which is 
drawn from material with which the student is not likely to 
have yet had contact, or (c) be ona problem known to the 
student but a new slant that he is unlikely to have thought of 
previously. Ideally we are seeking a problem which will 
test the extent to which the individual has learned to apply 
the abstraction in a practical way. This means that the 
problems should have some relation to the situations in 
which he may ultimately be expected to apply the abstrac- 
tions, The kinds of problems that come from the three 
above sources do not always meet this criterion. To the 
extent that fictional problem situations--(a) above--are un- 
real, contrary to fact, or bizarre they do not seem as likely 
to elicit valid behavior as situations of a more common and 
realistic nature. Situations drawn from material with which 
the student is not yet likely to have had contact --(b) above-- 
are usually drawn from advanced material and simplified 
for use in an earlier grade. It is frequently difficult to suf- 
ficiently simplify the situations and yet retain their reality. 
Further, the bright student often blocks this source of 
new situations by having read ahead or done outside reading, 
and so familiarized himself and sometimes his playmates 
with them. The new slant on common situations--(c) above-- 
probably represents our most suitable source of new, yet 
realistic items. They are, however, extremely hard to 
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Testing for Application, and illustrative test items 
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devise, The PEA Application of Principles Test used this 
source of items. 


General problem-solving ability vs. application of specific 


principles 


If one is teaching a particular body of principles and 
wishes to evaluate the effect of this instruction, one is inter- 
ested not so much in the extent to which the student solves 
the problem by common sense or the use of commonly known 
information, but rather in the extent to which the student has 
directly benefited from the specific learning situations used. 
Problems which within themselves contain clues as to how 
they should be solved (such clues being interpretable by 
someone with little or no specialized knowledge) would not 
test application of the principles one has taught. One can 
determine the extent to which the test is not evaluating as 
desired by administering the items to persons who have 
not undergone the instruction in the area taught but who, 
nevertheless, are persons equal in general ability to those 
for whom the application items are designed. 


Diagnosing failure on application problems 


As is true of any test result, the indication that a stu- 
dent is unable to solve application problems may result 
from a number of causes besides the one that the student 
has failed to learn to apply. Failure on a problem may re- 
sult from (a) not correctly comprehending the problem ab- 
straction, (b) choosing the wrong abstraction, (c) incorrectly 
using the abstraction in the situation, or (d) incorrectly 
interpreting the results of using the abstraction in the situa- 
tion, It is important to distinguish inability to comprehend. 
This may be easily determined by testing the extent to 
which the student is comprehending the situation before he 
attempts the application items. Determination of the point 
of failure as other than failure to comprehend (b, c, or d 
above) requires that a sufficient record of the student's 
problem-solving behavior be kept to allow location of the 
breakdown point. It is impossible and unnecessary for us 
to record every thought that occurs to the student in the 
Solution of the problem. In general, it is sufficient to pro- 
vide opportunity for the student to record his preference at 
each choice point in the solution to the problem through hav- 
ing him describe or actually record his thoughts at that 
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point. If complete diagnosis is sought only on a few cases, 
having the student solve the problem aloud while an observer 
takes notes will get this information. If the cases are 
carefully chosen so as to be representative of the group, 
this latter technique will prove very feasible and economical 
for diagnosing the major troubles of the group as a whole. 
The technique is of great aid in the revision of the test items 
tomake them more valid andto find choice points that should 
be recorded. 


Providing opportunity for recording choice points sounds 
easy but is frequently very difficult in practice. Its implica- 
tion ig that we can anticipate all the correct as well as al- 
ternative problem-solving processes of the students. To 
avoid this, test constructors have tried to construct items 
which were so structured that by analyzing the student's 
answer one could infer the problem-solving process which 
the student used. That is, each distractor in a problem can 
be so phrased that it can be reached only by one set of prob- 
lem-solving steps. By knowing the answer choice the student 
made we would then know the method he used to solve the 
problem. Verbal problem solving, in general, has shown 
that the types of items and variety of subject matter in 
which this technique can be successfully used are few. 
Although it may appear that the process can be inferred, 
studies usually show that students can come up with ways 
of arriving at answers, often correct, that no teacher 
seems to have anticipated. When accurate knowledge of 
process is required, actual recording of the student's 
problem-solving processes can be considered generally 
preferable in the majority of cases to inference from the 
product. 


2 The recently developed "Tab Itém" technique is an 
attempt todo this. In aletterto the editor, Robert Glaser 
has described the Tab Item: 


"A Tab Item presents an examinee with the follow- 
ing: a description of a problem situation; a series 
of diagnostic procedures which, if employed, might 
yield information relevant to solving the problem; 
and a list of specific solutions, one of which is cor- 
rect. In taking the test an examinee selects any 
number of the procedures presented which he thinks 
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Adequate sampling of application 


We have stated that we wish to sample a student's be- 
havior at several points in his application of abstraction to 
a problem situation but have not mentioned the obvious 
corollary that we should also sample the student's behavior 
over several problem situations. This is a general rule 
of testing and is another way of achieving what we commonly 
call "test reliability." It is, however, of particular 
importance with respect to application items. Since these 
items are often felt to be so difficult to construct, the use 
of a single problem situation to make generalizations about 
an individual is fairly common. Since the student's ability 
may often clearly be a function of the particular situation 
used, the necessity for taking a sample of situations is 
apparent. 


will provide him with information necessary to solve 
the problem. The resulting information from what- 
ever procedures the examinee chooses are given to 
him at the time he selects them. This is accom- 
plished by giving the results or consequences ofa 
procedure in the form of written or diagrammatic 
information, which is covered by a tab fastened to 
the page. When the examinee selects a procedure 
he rips off thetab andobtains the results ofthe pro- 
cedure he has 'performed'. Ina like manner an 
examinee is informed of the correctness or incor- 
rectness of his choice of a solution. An examinee 
works on an item until he finds the correct solu- 
tion, denoted by the word 'yes' under the corres- 
ponding tab." 


Glaser, R.; Damrin, D. E.; and Gardner, F.M. "The Tab 
Item: A Technique for the Measurement of Proficiency in 
Diagnostic Problem Solving Tasks," Champaign: Univer- 
sity of Illinois, College of Education, Bureauof Research 
and Service, June 1952. 
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Types of items illustrated 


Major variations occur both in the kinds of situations 
posed, and in the extent and nature of the behavior requested 
in application items. 


Behavior, The major variations in behavior involve varia- 


tions in the extent to which the student is required to carry 
through the application process, and variations inthe extent 
to which the student's problem-solving processes are re- 
corded. These variations seem to occur most commonly 
in the following patterns: 


Type 


1) A recording of the choice of correct principle(s) is 
requested and its use in the problem is to be dem- 
onstrated. Practically the whole application pro- 
cess is on record. 


2) The problem solution is requested and the process 
of application is to be demonstrated and recorded. 
The student's selection of the abstraction(s) is in- 
ferred from the nature of the process and solution 
he displays. 


3) The complete or partial problem solution alone is 
requested and recorded. The selection and applica- 
tion of the abstraction(s) is entirely covert and un- 
recorded. They are inferred from the nature of the 
solution he presents. In some instances where only 
the solutton is requested, if the solutionis a complex 
one, it is sometimes difficult to determine whether 
the individual actually has applied the abstraction 
correctly so that the whole solution is correct. In 
these instances the extent of the student's solution and 
its correctness is sometimes explored by asking the 
student to indicate the implications of it. 
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4) 


Selection of the correct abstraction is alone requested 
andrecorded. If aphenomenon is to be explained, the 
correct application of the abstractionis generally as- 
sumed to accompany a correct selection. Although 
merely naming the abstraction is not usually a suffi- 
cient test of ability to use the abstraction correctly, 
problems requiring only the selection of the correct 
abstraction can be used when the abstraction and its 
application are simple and the problem's chief diffi- 
culty lies in selecting the correct abstraction. 


Situation. As noted earlier, the emphasis in writing appli- 
cation items is on getting situations new to the student, This 
is done by 


Type 


A) 


B) 


C) 


presenting a fictional situation, 


using material with which the student is not likely 
to have had contact. Suchsituations are frequently 
simplified versions of complex material which 
would ordinarily come considerably later in the 
course of study (classification of an item as of 
this type is dependent entirely upon the group to 
whom it is administered), 


taking a new slant on situations which to the group 
being tested are common and mundane. In highly 
technical areas, "common" problems may appear 
very uncommon to an outsider. 
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3,00 - APPLICATION -- ILLUSTRATIVE TEST ITEMS 


Behavior. This adaptation of a PEA item requires the 
student to select the appropriate principles and extrap- 
olate beyond the situation given. The principle must 
be drawn from memory in this essay type item. 

(Type 1) 


Situation. The situation, while probably not within the 
direct experience of all, is at least within their vicari- 
ous experience. It could be considered as a new slant 
on a fairly common phenomenon, (Type C) 


1, John prepared an aquarium as follows: He carefully cleaned a 
ten-gallon glass tank with salt solution and put in a few inches of fine 
washed sand. He rooted several stalks of weed (elodea) taken from a 
pool and then filled the aquarium with tap water. After waiting a week 
he stocked the aquarium with ten one-inch goldfish and three snails. 
The aquarium was then left in a corner of the room. After a month 
the water had not become foul and the plants and animals were in good 
condition. Without moving the aquarium he sealed a glass top on it. 


What prediction, if any, can be made concerning the condition of 
the aquarium after a period of several months? If you believe a defi- 
nite prediction can be made, make it and then give your reasons. If 
you are unable to make a prediction for any reason, indicate why you 
are unable to make a prediction (give your reasons). 


3 Adapted from Test 1.3B, "Application of Principles in Science, ' 
Progressive Education Association, Evaluation in the Eight-Year 
Study, University of Chicago, 1940. 
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Behavior. This PEA item is an attempt to get a record of the major 
aspects of the process of application but yet to use an objective 
test item form, The item form reverses the expected problem- 
solving procedure in that the student states his solution and then ra- 
tionalizes it by choosing principles to support it. (Type 1) 
Situation. This is a different way of looking at a common phenome- 
non for most students. (Type C) 


Problem VI from PEA Test 1.3, Application of Principles 


2. An electric iron (110 volts, 1000 watts) has been used for some 
time and the plug contacts have become burned, thus introducing addi- 
tional resistance. How will this affect the amount of heat which the 
iron produces? 


Directions: Choose the conclusion which you believe is most con- 
sistent with the facts given above and most reasonable in the light of 
whatever knowledge you may have, and mark the appropriate space on 
the Answer Sheet under Problem VI. 


Conclusions: 
A. The iron will produce more heat than when new. 
B. The iron will produce the same heat as when new. 
C. The iron will produce less heat than when new. 


Directions: Choose the reasons you would use to explain or support 
your conclusion and fill in the appropriate spaces on your Answer Sheet. 
Be sure that your marks are in one column only--the same column in 
which you marked the conclusion. 


Reasons: 

1. The heat produced by an electrical device is always measured by 
its power rating. It is independent of any contact resistance. 

2. Electric currents of the same voltage always produce the same 
amount of heat, and burned contacts do not decrease the amount 
of electricity entering the iron. 

3. The current which flows through the iron is reduced when the re- 
sistance is increased. 

4, Increasing the resistance in an electrical circuit increases the 
current. 

5, An increase in electrical resistance increases the heat developed. 

6. Manufacturers of electric irons urge that the contacts be kept 
clean to maintain maximum efficiency. 4 

7. An increase in the temperature of a wire usually results in an 
increase in its resistance. 

8. Burned contacts increase the heat developed in an electric iron 
just as increasing the friction in automobile brakes develops 
more heat. 

9. The heat developed by an electric iron when connected to 110 
volts is independent of the flow of current. 


3 


Behavior. 
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In the following problem both the solution and 
process of application are requested, The student's cor- 
rect selection of the abstraction, in this case à method of 
solving this type of problem, is inferred from the process 
and the solution he displays. (Type 2) 


Situation. The problem situations are fictional and prob- 
ably not realistic from the standpoint of most of the groups 
which would be tested, If this problem or one just like it 

had been solved in classwork, this would be a comprehen- 
sion rather than an application item. (Type A) 


X and Y can do a piece of work together in 15 days, They work 


together for 6 days; then X quits and Y finishes the work in 30 more 


days. 


In how many days can Y do the piece of work alone? Show your 


work below. 


(a) 30 
(b) 40 
(c) 50 
(d) 60 
(e) none of the foregoing 


Behavior. This item is similar to the preceding item in 
terms of the way that it tests application. In this instance 
the abstraction being tested is a formula relating the area 
to the length and width of a rectangle. (Type 2) 


Situation. The problem is fictional. As noted in regard to 
the preceding item, if too close to the problems used in 
class, it would test comprehension rather than application, 


(Type A) 


4, The length of a rectangular lot exceeds its breadth by 20 yards, If 


each dimension is increased by 


20 yards the area of the lot will be 


doubled, Find the shorter dimension of the original lot. Show your work 


below, 


(a) 20 
(b) 30 
(c) 35 ° 
(d) 40 
* (e) none of the foregoing 
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Behavior. The student must recall the principles of ecology and 
apply the appropriate ones to the situations named in the item. 
Only the solution is requested, (Type 3) 


Situation. The situations are real but the student is not likely to 
be familiar with them. (Type C) 


5. After the number on the answer sheet corresponding to that pre- 
ceding each of the following paired items, blacken space 
A- if increase in the first of the things referred to is usually ac- 
companied by increase in the second. 
B- if increase in the first of the things referred to is usually ac- 
companied by decrease in the second. | 
C- if increase in the first of the things referred to has no appre- 
ciable effect on the second. 


1, Number of lemming in an Arctic habitat. 
' Number of caribou in the same habitat. 


2, Number of lichens in an Arctic habitat. 
Number of caribou in the same habitat. 


3, Amount of carbonates dissolved in the water of a river. | 
Number of clams in the river. 


4, Temperature of the environment of a mammal. 
Body temperature of the mammal. 


5, Compactness of the soil of a given area. 
Amount of water absorption by the soil after a heavy rain. 


6 Frequency of fire in a given coniferous forest. 
' Number of aspen trees in the forest. 


7, Crop yield per acre of farmland cultivated in Illinois. 
Amount of soil nutrients per acre of farmland. 


g, The altitude of the environment of an animal. 
Extent to which the circulating red blood cells of the animal 
undergo mitosis. 


g, Extent of tree planting activity on forest land in the United 
States. 
Degree of water absorption by the soil per unit of area of 
the same land. 
10, Amount of vegetation per square yard of soil. 
Amount of available nitrate salts in the same area of soil. 


11, Amount of humus accumulated in sand during dune succession. 
Abundance of animal life in the area. 
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Behavior. In this item the student is to judge the implications of ap- 
plying a given policy for the distribution of income. The policy situ- 
ation is given and the implication alone is asked for. The principles 
involved and their use in determining the implications must be in- 
ferred from the student's choice. (Type 3) 


Situation, The situation is fictional in that the setting of the problem 
is abstract and the student is presented with a simplified economic 
situation where only one variable at a time is changed. (Type A) 


6. Directions: In the following items you are to judge the effects of a 
particular policy on the distribution of income. In each case assume 
that there are no other changes in policy which would counteract the ef- 
fect of the policy described in the item. Mark the item: 


A- if the policy described would tend to reduce the existing degree 
of inequality in the distribution of income; 
B- if the policy described would tend to increase the existing de- 
gree of inequality in the distribution of income; or 
C- if the policy described would have no effect, or an indetermi- 
nate effect, on the distribution of income. 
Items: 
1. Increasingly progressive income taxes. 
2. Confiscation of rent on unimproved urban land. 
3. Introduction of a national sales tax. 


4. Increasing the personal exemptions from income taxes. 


5. Distributing a subsidy to sharecroppers on Southern 
farms. 


6. Provision of educational and medical services, and low 
cost public housing. 


7. Reduction in the degree of business monopoly, 


8. Increasing taxes in periods of*prosperity and decreasing 
them in periods when depressions threaten. 


Behavior. The student is asked to find the solution. Correct selectio 
land use of the appropriate principle is inferred from the solution. 
(Type 3) 


Situation, Strictly a fictional situation, but having a realistic-sounding 


7, Suppose an elevator is descending with a constant acceleration of 
gravity "g". If a passenger attempts to throw a rubber ball upward, 
what will be the motion of the ball with respect to the elevator? The 
ball will 
1, remain fixed at the point the passenger releases it. 
2. rise to the top of the elevator and remain there. 
3. not rise at all, but will fall to the floor. 
4, rise, bounce off the ceiling, then move toward the floor at a 
constant speed. 
5, rise, bounce off the ceiling, then move toward the floor at an 
increasing speed. 


Behavior. Here one can test both the correct selection and use of the 
abstra ction since the problem is to explain a phenomenon. (Type 4) 


ituation. A common problem is used. (Type C) 


Directions: The underlined statement at the end of the problem is as- 
sumed to be a correct answer. You are to explain the underlined con- 
clusion by selecting statements from the list following the problem. 
(The student checks the explanations.) 


8. Ifa person is planning to bathe in the sun, at.what time of day is 
he most likely to receive a severe sunburn? He is most likely to re- 
ceive a severe sunburn in the middle of the day (11 a.m. to 1 p. m.) 
because: 

( ) We are slightly closer to the sun at noon than in the morning 
or afternoon. 

( ) The noon sun will produce more "burn" than the morning or 
afternoon sun. 

( ) When the sun's rays fall directly (straight down) on a surface, 
more energy is,received by that surface than when the sun's 
rays fall obliquely on that surface. 

( ) When the sun is directly overhead the sun's*rays pass through 
less absorbing atmosphere than when the sun is lower in the 
sky. 

( ) The air is usually warmer at noon than at other times of the 
day. 

( ) The ultraviolet of the sunlight is mainly responsible for sun- 
burn. 


^ Taken from Inventory 1.5, Analyzing Health Problems; Coopera- 
tive Study in General Education. American Council on Education, Uni- 
versity of Chicago, 1941. 
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Behavior. The student must recall the principles of solar 
and planetary movement and apply them to each of the re- 
sponse possibilities to determine whether the problem sit- 
uation might be a resultant, Only the solution need be re- 
corded. (Type 3) 


Situation. Fictional. (Type A) 


9, You have acquired some knowledge of the earth and its motions as 
they really exist. In this exercise you are to identify the effects of 
some wholly imaginary conditions, After each item number on the 


answer 
A- 


B- 


C- 


iz] 
D 


B- 


sheet blacken space 

if the item would be true if the earth were not inclined on 
its axis. 

if the item would be true if the orbit of the earth were a circle 
rather than an ellipse. 

if the item would be true if the earth revolved toward the west 
rather than toward the east. 

if the item would be true if the earth had half its present diame- 
ter but retained its present mass. 

if the item would be true if the earth had no moon, 


Assume only one of the above imaginary conditions occurs at a time. 


ee 


2. 


All the solar days would be of equal length. 

Objects would weigh four times as much as they do now. 

The celestial equator and the ecliptic would be identical. 

The sun would set in the east. 

A different North Star would need to be chosen. 

The force of gravity would be four times as great, 

The orbital speed of —— would not vary during the year, 


We would know much less about the nature of the sun, 


LJ 
Night and day would be of equal length in all latitudes 
all yeare9long. 
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When on Thursday, February 8, 1951a Chicagoan, Mrs. Dorothy 
Mae Stevens, was found unconscious in a passageway after a night of 
exposure to ll degree subzero weather, "she was literally frozen stiff. 


Her temperature had dropped to an unprecedented 64 degrees (Fahr- 
enheit). Twenty hours after her arrival at Michael Reese Hospital, her 
temperature had risen to 98.2 degrees. Early Friday it was 101 and lat- 
er100. On Saturday it was also 100. 


When she was first found, her respiration was slowed to 3 a min- 
ute. By Saturday it was up to 24 a minute. 


Her blood pressure was zero on Thursday. By Saturday it was 
132 over 80. On Thursday her pulse rate was 12 a minute; on Saturday 
it was 100. Cortisone was administered early. 


Behavior. This item requests solution and the princi- 
ple used. (Type 1) 


Situation. At the time the item was written Mrs. Stevens' 
case was headline news. The item assumes that the stu- 
dent has not previously thought about these aspects of the 


case. (Type C) 


10. At a body temperature of 64 degrees 


A- the blood carries more oxygen to the cells than normally, be- 
cause more gases dissolve in fluids at low temperatures 
rather than at high temperatures. 

B- the blood vessels of the skin are dilated, because the vasocon- 


strictor muscles are relaxed. 

C- the heart beats more rapidly, because the cold stimulates the 
heart center in the medulla. 

D- most activities slow down, because all chemical activities 
decrease as the temperature falls. 


Behavior. Only the solution is requested, the abstrac- 
tion used must be inferred from the student's choice. 
(Type 3) : 


Situation, See previous problem. 


li. The immediate cause of Mrs. Stevens! unconsciousness was 
probably due to the 


A- lack of a sufficient amount of oxygen to the brain cells. 
B- lowering of the external temperature. 

C- slow pulse rate. 

D- decrease in muscle tone. 

E- low breathing rate. 


139 


Behavior. The solution alone is requested. (Type 3) 


Situation. See first problem of this series, 


12, When Mrs, Stevens was found in subzero weather her heart was 
beating 


A- 12 times a minute. 

B- 3 times a minute. 

C- 0 times a minute. 

D- the normal number of times a minute, but not with normal 
vigor. 

E- subnormally, but there is nothing in the article to indicate 
how many times. 


Behavior. The student must determine the principles in- 
volved in the production of steam which might apply to 
each of the distractors, He then determines whether this 
is realistic insofar as the situation is concerned, This 
leads him to a choice. An aspect of the solution is re- 
(Type 3) 


quested. 


Situation. A realistic situation probably not previously 
considered by the student. (Type C) 


After each exercise number on the answer sheet, blacken the one 
lettered space which designates the correct answer. 


13, When a geyser first begins to erupt, hot water overflows at the 
orifice and this is followed by a rush of steam, mingled with hot water. 
The first overflow of hot water aids in the production of steam, because 


A- less water needs to be heated. 
B- more water can seep into the fissure from the surrounding 


rocks, 
C- the higher the pressure, the greater the steam produced, 
D- the lower the pressure, the lower the temperature at which 


steam ig produced, 
E- the water which overflows is necessaril 


temperature. 


y below 212° F. in 
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Behavior. Proper application of the operating principles of certain 
bodily mechanisms permits the student to predict the direction and 
amount of change which will result from each of the two experiments. 


(Type 3) 


Situation, This is a fictional experiment which is so devised that it 
permits the demonstration of certain principles. (Type A) 

14. 

Experiment A: A normal person is seated inside a small airtight cham- 
ber in which the air at the start of the experiment has a temperature of 
129 F. and a relative humidity of 60. By means of a mask and pipes the 
person breathes air drawn in from outside the chamber and the air he 
exhales is also passed out of the chamber. 


Experiment B: The same person is later seated outside of the same 
chamber, but by means of the mask and pipes breathes air drawn from 
the chamber and the air he exhales is also passed into the chamber. The 
composition of the air, air pressure, temperature, and humidity were 
the same outside and inside the chamber at the start of each of the ex- 


periments, 
After each item number on the answer sheet, blacken space 
A- if the statement applies to Experiment A. 
B- if the statement applies to Experiment B. 
C- if the statement applies to neither Experiment A nor Experi- 
ment B. 


The rate and depth of breathing increase more rapidly in this experi- 
ment than in the other experiment. 


The rate and amount of perspiration increase more rapidly in this ex- 
periment than in the other experiment. 


The humidity and temperature of the air in the chamber increase more 
rapidly in this experiment than in the other experiment. 


The Og concentration of the air in the chamber increases appreciably. 
The CO9 concentration of the air in the chamber increases appreciably. 
The percentage of heat loss through evaporation decreases greatly. 


The activity of the respiratory center of the medulla increases consid- 
erably. 


The activity of the respiratory center of the medulla decreases consid- 
erably. 


The number of impulses passing through the phrenic nerves in à given 
unit of time increases considerably. 


The number of impulses passing through the vagus nerves in a given 
unit of time increases considerably. 
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Behavior. The student must determine the general principles which 
operate in the situation described and then predict the most likely 
event. (Type 3) 

Situation. A fictional situation. 


(Type A) 


15. Mr. Golzak, Mr. A.F. Fell, Mrs. Hunter, and Boss Powers live 
in Steel City. 
Mr. Golzak was born 60 years ago in Central Europe. Today Mr. Gol- 
zak is one of Steel City's top business leaders. The Golzak family has 
"arrived." Wealthy Mrs. Golzak dominates the social life of their 
swank suburb, Mapledale. Mr. Golzak, personnel manager for Amal- 
gamated Steel, believes in "rugged individualism." Personal freedom 
allows enterprising men (such as himself) to achieve wealth and posi- 
tion, just as freedom from governmental restraint for business assures 
national prosperity and a "full dinner pail" for all. Mr. Golzak believes 
labor unions destroy workers! initiative and undermine business. 


Mr, A.F. Fellwas born in Steel City in a working-class neighborhood. 
Like his father, Mr. Fell became a printer's apprentice at 16, and 
then a life-long member of the International Typographical Workers 
Union, He works as.a typesetter for the "Steel City Sentinel." Mr. Fell 
believes that management and labor should settle their differences en- 
tirely between themselves by collective bargaining. Mr. Fell makes 
$1.90 per hour, owns his own home and sends his children to the city 
junior college. He believes his union has made this possible. 


Mrs, Hunter is the wife of a steel workers. Mr. Hunter belongs to the 
É unters and three other families share a "modest" home 
(owned by Mr. Golzak) three blocks downwind from the steel mill. Mrs. 
Hunter attended a Southern school for Negroes for four years, off and 
on. She has little understanding of social and economic problems, but 
she worries over such personal problems as clothing for four growing 
children, privacy in her own home, paying the butcher during the steel 

strike, and Junior who "borrows" bicycles. 


Boss Powers, slum-born son of an Irish saloon-keeper, learned con- 
viviality early in life and led his gang against the Prairie Avenue Dukes. 
Soon he was leading his Ward Organization against the Republicans. 
Today he is unquestioned as Democratic Boss of Steel City. He enjoys 
the fruits of victory. 


1. A business recession would probably mean unemployment for 
(A- the Fells and the Hunters; B- Boss Powers; C- the Hunters; 
D- none of these). 


2. Mr. Fell's home is probably (A- near the steel mill; B- in Maple- 
dale; C- in the zone of transition; D- among twenty-year-old 
single dwelling finits). 


3. A bill is before Congress to admit an additional 100, 000 displaced 
persons. Most likely to favor the bill is (A- Mr. Golzak, personnel 
manager for Amalgamated Steel; B- Mrs. Hunter, wife of an un- 
Skilled laborer; C- Mr. Fell, skilled craftsman; D- Boss Powers, 
son of an immigrant). 


4. Mrs. Fell has chronic headaches although her doctor can find noth- 
ing organically wrong with her. Her headaches are most probably 
a result of (A- personal maladjustment; B- approaching insanity; 
C- hidden germs; D- an inherited mental weakness). 
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Behavior. 


Situation, 


Fictional. (Type A) 


The student must apply the physics principle correctly 
in each case. Only the solution is requested. (Type 3) 


16, The numbers preceding the paired items in the exercise below refer 
to the corresponding numbers on the answer sheet, Considering each 
pair from the standpoint of quantity, blacken space 

A- if the item at the left is greater than that at the right. 

B- if the item at the right is greater than that at the left. 

C- if the two items are of essentially the same magnitude. 


Two spheres, X and Y, of equal masses and radii, are placed on two in-i 


L M 


Plane II 


clined planes, as shown in the diagram. Neglect friction and air resist- 
ance, and assume that potential energy is measured from the level of 
points L, M, N, and O. 


1. Potential energy of X at F........ .. Potential energy of Y at H. 
2. Potential energy of Xat M. .... Potential energy of Y at N. 
3, Potential energy of XatM.......... Potential energy of X at L, 
4. Kinetic energy of X on rolling to L .. Kinetic energy of X on falling 
to M. 
5. Kinetic energy of X on rolling to L .. Kinetic energy of Y on rolling 
to O. 
6, Work done on X in raising it from Work done on X in moving it 
P Pm TU NM PU from L to F, 
7. Work done on X in raising it from Work done on Y in raising it 
Mo E. scooeserenseoecis vseneoons from N to H. 
8. Acceleration of X in rólling down Acceleration of Y in rolling 
incline toward L,......... fence down incline toward O. 
9, Acceleration of X in falling ver- Acceleration of Y in falling 


tically toward. M «p ee sesoto sjs sise 
10. Time it takes X to falltoM......... 


vertically toward N. 
Time it takes Y to fall to N. 


11 Time it takes X to roll to L.. . ..... Time it takes X to fall to M. 
12. Loss of potential energy of X in Loss of potential energy of 
LOG Ca ome Nee ooo gene Jon Hee ds Y in falling to K. 
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Behavior. The student must recall the general principles of supply 
and demand and determine their use in each situation to determine 
the effect of the situation. Solution only is requested, (Type 3) 


Situation. Fictional situations which exemplify the points involved, 


, Y- Original 
\ / Supply Curve 


17, In the diagram above the unbroken lines represent the original 
supply and demand condition for each of the products listed below, 
For each product a change of conditions is specified which may cause 
a shift in either or both of the original curves, such that the new point 
of intersection is at A, B, C, D, or E, (B and D represent shifts in 
demand or supply, but not both, while A, C, and E represent a shift in 
both supply and demand,) 


After the answer sheet number which precedes each product, blacken 
the lettered space which designates the point of intersection of the 
curves which apply to the new conditions, Assume that there are no 
other changes in supply or demand than those specified, Assume also 
that there are no restrictions which interfere with the existence of a 


free market, 


Product * New Conditions 
1, Automobiles ...... New union agreements have practically eliminated 


labor grievances. Those who most urgently 
wanted new cars have been supplied. 


3. Butter i iii ve .. During the winter months production is lowest, 
Taxes on oleomargarine have been eliminated, 

3. Shoes ........... . Stockmen are holding back beef cattle from the 
market in anticipation of higher prices. 

4. Oysters .......... The Chesapeake Bay oysters are found to be suc- 


cumbing to sicknesses induced by increasing 
pollution of the bay. 


4.00 - ANALYSIS 


At a somewhat more advanced level than the skills of 
comprehension and application are those involved in analy- 
sis. In comprehension the emphasis is on the grasp of the 
meaning and intent of the material. In application it is on 
remembering and bringing to bear upon given material the 
appropriate generalizations or principles. Analysis empha- 
sizes the breakdown of the material into its constituent parts 
and detection of the relationships of the parts and of the way 
they are organized. It may also be directed at the techniques 
and devices used to convey the meaning or to establish the 
conclusion of a communication. 


Although analysis may be conducted merely as an exer- 
cise in detecting the organization and structure of a commu- 
nication and may therefore become its own end, it is prob- 
ably more defensible educationally to consider analysis as an 
aid to fuller comprehension or as a prelude to an evaluation 
of the material. 


Skill in analysis may be found as an objective of any field 
of study. It is frequently expressed as one of their impor- 
tant objectives by teachers of science, social studies, phi- 
losophy, and the arts. They wish, for example, to develop 
in students the ability to distinguish fact from hypothesis in 
a communication, to identify conclusions and supporting 
Statements, to distinguish relevant from extraneous mate- 
rial, to note how one idea relates to another, to see what un- 
stated assumptions are involved in what is said, to distin- 
guish dominant from subordinate ideas or themes in poetry 
or music, to find evidence of the author's techniques and 
purposes, etc., etc. 


No entirely clear lines can be drawn between analysis and 
comprehension at one end or between analycis and evaluation 
at the other. Comprehension deals with the content of mate- 
rial, analysis with both content and form. One may speak of 
"analyzing" the meaning of a communication, but this usually 
refers to a more complex level of ability than "understand- 
ing" or "comprehending" the meaning -- and that is the inten- 
tion in the use of "analysis" here, It is true also that analy- 
sis shades into evaluation, especially when we think of "crit- 
ical analysis." As one analyzes the relationships of elements 
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of an argument, he may be judging how well the argument 
hangs together. In analyzing the form of a communication, 
or the techniques used, one may express opinions about how 
well the communication serves its purpose. 


And yet the type of ability we call analysis may be ab- 
stracted, and usefully. One who comprehends the meaning 
of a communication may not be able to analyze it at all ef- 
fectively, and one who is skillful in the analysis of material 
may evaluate it badly. In the selection of the illustrative ed- 
ucational objectives and test items which follow, an attempt 
has been made to use materials clearly above the level of 
comprehension and below that of evaluation. 


Analysis, as an objective, may be divided into three 
types or levels. At one level the student is expected to 
break down the material into its constituent parts, to identi- 
fy or classify the elements of the communication, At a sec- 
ond level he is required to make explicit the relationships 
among the elements, to determine their connections and in- 
teractions. A third level involves recognition of the organi- 
zational principles, the arrangement and structure, which 
hold together the communication as a whole. 


4.10 - Analysis of Elements 


A communication may be conceived of as composed of a 
large number of elements. Some of these elements are ex- 
plicitly stated or contained in the communication and can be 
recognized and classified relatively easily. Thus, the read- 
er of a communication should have little difficulty in recog- 
nizing the hypotheses which are being investigated since they 
are likely to be so identified by the writer. He may also be 
able to recognize the conclusions the Writer is drawing be- 
cause these are also likely to be stated explicitly by the 
writer. 


However, there are many other elements in a communi- 
cation which are not so clearly labelled or identified by the 
writer. Many of these elements may be of paramount impor- 
tance in determining the nature of the communication, and 
until the reader can detect them he may have difficulty in 
fully comprehending or evaluating the communication. Thus 
there are unstated assumptions being made by the writer 
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which can only be inferred from an analysis of a series of 
statements within the document. It is also of value to the 
reader if he can detect the nature and function of particular 
statements in the communication, Some are statements of 
fact, some are statements of value, while others may be ` 
statements of intent. Many other types of statements may 
be included and it is left to the reader to determine the na- 


ture of each. 


4.10 - Analysis of Elements--Illustrative Educational 
Objectives 


The ability to recognize unstated assumptions. 
Skill in distinguishing facts from hypotheses. 


The ability to distinguish factual from normative state- 
ments, 


Skill in identifying motives and in discriminating between 
mechanisms of behavior with reference to individuals and 
groups. 


Ability to distinguish a conclusion from statements which 
support it. 


4.20 - Analysis of Relationships 


Having identified the different elements within a commu- 
nication, the reader still has the task of determining some 
of the major relationships among the elements as well as 
the relationships among the various parts of the communica- 
tion. At the most obvious level he may need to determine 
the relationship of the hypotheses to the evidence, and in 
turn the relationship between the conclusions and the hypothe- 
ses as well as evidence. Analysis would also include the re- 
lationships among the different kinds of evidence presented. 


At a more difficult level is likely to be the analysis of a 
communication into the parts which are essential to or which 
form the main thesis as contrasted with those parts or ele- 
ments which may help to expand, develop, or support this 
thesis. Much of analysis of relationships may deal with the 
consistency of part to part, or element to element; or the 
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relevance of elements or parts to the central idea or thesis 
in the communication, 


4.20 - Analysis of Relationships--Illustrative Educational 
Objectives 


Skill in comprehending the interrelationships among the 
ideas in a passage. 


Ability to recognize what particulars are relevant to the 
validation of a judgment. . 


Ability to recognize which facts or assumptions are es- 
sential to a main thesis or to the argument in support of 
that thesis. 


Ability to check the consistency of hypotheses with given 
information and assumptions. 


Ability to distinguish cause-and-effect relationships from 
other sequential relationships. 


Ability to analyze the relations of statements in an argu- 
ment, to distinguish relevant from irrelevant statements. 


Ability to detect logical fallacies in arguments, 


Ability to recognize the causal relations and the impor- 
tant and unimportant details in an historical account, 


4.30 - Analysis of Organizational Principles 


At an even mofe complex and difficult level is likely to 
be the task of analyzing the structure and organization of a 
communication. Rarely will the producer of a communica- 
tion explicitly point out the organizational principles he has 
used and quite frequently he may not be aware of the princi- 
ples he has utilized. Thus, his purpose, point of view, atti- 
tude, or general conception of a field may be discerned in 
the writing and the reader may be unable to fully comprehend 
or evaluate the communication until he has determined them. 
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Similarly, the producer of a communication selects some 
form, pattern, or structure and organizes his arguments, 
evidence, or other elements around these. The analysis of 
these underlying organizational qualities should help in the 
comprehension as well as evaluation of the entire communi- 
cation. Frequently it is impossible to make an evaluation 
until this has been done. 


4.30 - Analysis of Organizational Principles --Illustrative 


Educational Objectives 


Ability to analyze, in a particular work of art, the rela- 
tion of materials and means of production to the "ele- 
ments" and to the organization, 


The ability to recognize form and pattern in literary or 
artistic works as a means of understanding their mean- 
ing. 


The ability to infer the author's purpose, point of view, 
or traits of thought and feeling as exhibited in his work. 


Ability to infer an author's concept of science, philosophy, 
history, or of his art as exemplified in his practice. 


Ability to see the techniques used in persuasive materi- 
als, such as advertising, propaganda, etc. 


Ability to recognize the point of view or bias of a writer 
in an historical account, 
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Testing for Analysis, and illustrative test items 


In testing the ability to analyze, the student may be 
asked questions about some material with which he is pre- 
sumed to be familiar, or the material for analysis may be 
presented to him in the test situation. His ability to ana- 
lyze material is usually tested more dependably in the latter 
case, for then one can be more confident that his answers 
are not affected by lack of familiarity with the material or 
inability to remember it adequately. While it is true that 
knowledge is used, and is often required, in making an ade- 
quate analysis of any communication, there are few occa- 
sions when one must analyze material without having that 
material before him. If the material to be analyzed is new 
to the student, and appropriate questions are used, it is 
likely to be a genuine test of his analytical abilities, for he 
has no opportunity to use analytical comments which he sim- 
ply recalls from previous discussions of the material. 


The material given for analysis in a test may be a liter- 
ary passage, a description of a scientific experiment or a 
social situation, a set of data, an argument, a picture, a 
musical selection, etc., etc. Or the student may be placed 
in an actual situation, such as a laboratory in which he ana- 
lyzes the reactions of materials, or a classroom in which he 
must analyze the interactions of members of the group, or-- 
as is well known in military training and testing--a field sit- 
uation in which he must identify and relate a variety of fac- 
tors. 


The student may show his ability by making a Series of 
free or guided responses, or by selecting the best answers 
to objective questions. An advantage, of the latter method 
is that items can be structured so that the answers include 
common errors Which students are likely to make. 


The errors in analysis may be grouped as follows: 
A. Crude errors 
Misjudging the nature of elements of the communi- 


cation or the relationships between elements. Con- 
fusing basic and subordinate elements. 


Inability to identify forms and patterns. Failure 
to see the bearing of elements upon the intent of 
the communication as a whole. 


Incomplete analysis 


The student may be essentially "on the right track, y 
but he misses some of the elements, relationships, 
or principles which he ought to see. 


Over -analysis 


Some students go too far in their effort to analyze 

a communication, breaking it up into more minute 
elements than is appropriate for the given material, 
and thereby often missing the more important rela- 
tionships. 


Other limited errors 


Test items may be so structured that several an- 
swers are partly right but one represents a more 
adequate analysis than the others. Here the dis- 
tinction is not between right and wrong, or between 
ability and inability, but is made in terms of the 
quality of analysis. 
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4.00 - ANALYSIS -- ILLUSTRATIVE TEST ITEMS 


4.10 - Analysis of Elements 


In Items 1 - 9 each item requires students to 
identify an element of a communication. No.8 
asks for an "important" unstated assumption, 
which would seem to involve analysis of rela- 
tionships; actually, however, all except one 
of the answers presented in the item are eith- 
er stated or not assumed, so that the student 
has only to identify the one answer which rep- 
resents an unstated assumption. 


l. Galileo investigated the problem of the Acceleration of fall- 
ing bodies by rolling balls down very smooth planes in- 
clined at increasing angles, since he had no means of de- 
termining very short intervals of time. From the data 
obtained he extrapolated for the case of free fall. Which 
of the following is an assumption implicit in the extrapo- 
lation? 


l. That air resistance is negligible in free fall. 

2. That objects fall with constant acceleration. 

3. That the acceleration observed with the inclined plane 
is the same as that involved in free fall. 

4. That the planes are frictionless. 

5. That a vertical plane and one which is nearly so have 
nearly the same effect on the ball, 


2. A and B were arguing about the desirability of adopting a na- 
tionwide system of compulsory health insurance in the 
United States. B said that, while he had no fundamental ob- 
jection to health insurance, he felt strongly that people 
Should not be compelled to participate in it. "Now, look 
here," he said, "Do the people want health insurance or 
don't they? I don't think they do, but in either case, com- 
pulsory insurance is bad. If the people really want health 
insurance, there is no need for compulsion. If they don't 
want it, it is impossible to force hem to participate. And 
so the answer is clear," 

* 
Which of the following statements most nearly expresses the 
logical conclusion of B's argument? 


Health insurance is bad. 

Compulsory health insurance is bad. 

. Compulsion is impossible. 

Compulsion is unnecessary. ; 
Compulsion is either unnecessary or impossible. 


[a wH 
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(Item 3 accompanies a reading passage in the test booklet.) 


3. Which of the following is an assumption,specific to this experi- 
ment, that was made in the determination of the charge ? 


l. The force of gravity is the same whether the drops are 
charged or not. 

. Opposite charges attract each other. 

Only a single charge is present on a drop. 

. The mass of a drop is equal to its density times its volume. 

. None of these. 


Coa 0t 


Items 4 and 5 refer to the following paragraph: 


"For what men say is that, if Iam really just and am not 

2 also thought just, profit there is none, but the pain and loss 
on the other hand is unmistakable. But if, though unjust, I 

4 acquire the reputation of justice, a heavenly life is promised 
to me. Since then appearance tyrannizes over truth and is lord 

6 of happiness, to appearance I must devote myself. I will de- 
Scribe around me a picture and shadow of virtue to be the 

8 vestibule and exterior of my house; behind I will trail the 
subtle and crafty fox." 


4. Which one of the following best states the major premise of the 


argument? 

1. "For what men say is" (line 1). 

2. "if I am really just" (line 1). 

3. "profit there is none" (line 2). 

4. "appearance tyrannizes over truth and is lord of happiness" 


(line 5). 
5. "to appearance I must devote myself" (line 6). 


5. Which one of the following best states the conclusion of the argu- 


ment ? 

1, "For what men say is" (line 1). 

2. "if I am really just" (line 1) 

3. "profit there is none" (line 2). 

4. "appearance tyrannizes over truth and is lord of happiness" 


(line 5). 
5. "to appearance I must devote myself" (line 6). 


(Other items, involving analysis of relationships, can be 
based on this same paragraph. See Item 17, below.) 
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Item 6 refers to the following situation: 


The college committee in charge of social regulations was hold- 
ing an open hearing on a proposal that the rule on chaperoning 
coeducational outings (wiener roasts, overnight hikes, campfires, 
etc.) should be more strictly applied. A student in the audience 
got the floor and made this speech: 


(A) This whole discussion is ridiculous, 

(B) for we shouldn't have chaperones at all! 

(C) You see, any chaperone you get will either arrange not to 
see what happens or he will be so badly outnumbered he 
can't keep track of what is going on. 

(D) But chaperones are supposed to guarantee that what goes 
on is respectable. : 

(E) So the chaperonage system is utterly ineffective and full 
of hypocrisy. 

(F) Besides, collegians will never develop maturity unless 
they are given responsibilities to exercise and are really 
trusted with these responsibilities. 


. There is one statement in the student's argument for which reasons 
are offered, but which he does not offer as a reason for any other 
statement. That statement, his main conclusion, is 


LA 4. E. 
z B; Bee 
3 vC. 


(The following question is based on an excerpt from Lindsay, 
The Modern Democratic State, which was distributed prior 
to the examination and students were permitted to refer to 
the book and to any notes during the examination. ) 


. The main question that Lindsay attempts to answer in Chapter I 
is: 


What is the sovereign authority in the state? 
What is the relation of law to sovereignty? 1 
What is the relation of authority and consent to sovereignty ? 


Is sovereignty advisable? L- 


Rone 


Items 8 and 9 refer to the following situation: 


A group of college students were discussing the relative merits 
of two grading systems. It had been suggested that only two 
grades be used: S (satisfactory) and U (unsatisfactory), instead 
of the A-B-C-D-F system then in use at the college. One student 
made the following statement: 
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"People go to college to learn, not just to get grades. Grades 


are no indication of absolute degree of learning, they are 
purely relative and then mostly determined by chance or 
probability (guessing, multiple-choice tests, etc.). The stu- 
dent is a better judge of how he is doing than the professor. 
Therefore, an S-U system would be better since it would cut 
down the amount of differentiation between grades and give a 
better picture of how the student is doing. ' 


8, An important unstated assumption involved in this argument is 


that 


T, 
2. 
3. 


4. 
5 


9. The 


the accuracy of the A-B-C-D-F system cannot or will not 
be significantly improved. 

people go to college to learn. 

the student is a better judge of how he is doing than the 
professor. 

an S-U system would be better. 

grades have no importance. 


conclusion of this student's argument is that 


grades should be abolished. 

students do not care about their grades. 

students should grade themselves. 

a new grading system should be substituted for the present 
one, 


the present grading system is better than the proposed 
substitute. 


(Other items, involving analysis of relationships, can 
be based on this same situation. See Items 18 and 19, 
below.) 
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4.20 - Analysis of Relationships 


Items 10 and 11 call for analysis of the relation- 
ships of statements in an argument, They accom- 
pany Item 6 in a test. 


Items 10 and 11 refer to the following situation: 


The college committee in charge of social regulations was holding 
an open meeting on a proposal that the rule on chaperoning coedu- 
cational outings (wiener roasts, overnight hikes, campfires, etc.) 
Should be more strictly applied. A student in the audience got the 
floor and made this speech: 


(A) This whole discussion is ridiculous,  « 

(B) for we shouldn't have chaperones at all! 

(C) You see, any chaperone you get will either arrange not to 
see what happens or he will be so badly outnumbered he 
can't keep track of what is going on. 

(D) But chaperones are supposed to guarantee that what goes 
on is respectable, 

(E) So the chaperonage system is utterly ineffective and full 
of hypocrisy. 

(F) Besides, collegians will never develop maturity unless 
they are given responsibilities to exercise and are really 
trusted with these responsibilities. 


10. The student offered A as a reason for 


lE B: 
2. Cs 
3. D. 
4. E. 
5. None of these. 


11, The student offered B as a reason for 


Ly S 
bie ies 
d on: 
4. E. 
5. None of these. 


(Similar items refer to statements C, D, E, and F.) 
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Items 12 - 14 require students to interpret the quoted 
Statement and to analyze the relations of elements of 
the statement and of the play to the general import of 
the statement. Items 12 and 13 involve analysis in 
terms of relevance; Item 14 involves analysis in terms 
of consistency. 


Items 12 to 14 are based on the following paragraph: 


"(1) Hamlet is given a command by the ghost of his murdered father 
to take vengeance upon the murderer, Claudius. (2) He is not able 
to do so immediately because he does not have sufficient proof that 
Claudius has murdered his father. (3) In the process of finding this 
proof, Hamlet unwittingly allows the king to discover his suspicions. 
(4) As the action proceeds, Hamlet cannot take vengeance because he 
never has a real opportunity to do so. (5) As the action ends, Ham- 
let becomes involved in a duel arranged by Claudius which has as its 
consequence the death of the hero and his adversary as well as the 
more important of the subordinate characters." 


12. A discussion and evaluation of the statement given above would 
revolve most around the points made in 
1. sentence 1. 
2. sentences 2 and 3. 
3. sentences 2 and 4. 
4, sentence 5. 


13. Assume, temporarily, complete agreement with the statement. 


In discussing various parts of the play, which among the follow- 
ing would you tend to minimize? 


Hamlet's interview with the ghost in Act I. 

The lapse of time between Acts I and II. 

The play within the play. 

Hamlet's departure for England. 

The short lapse of time between the play within the play 
and Hamlet's departure for England. 


oo wni 


14. Which of the following statements about Hamlet is least incon- 


sistent with the general position taken in the statement ? 


1. Hamlet is a man of action. 


2. Hamlet is by nature a meditative person, mot accustonted 
to meet problems by direct action. 

3. Hamlet is an intellectual, over whom someone more shrewd 
even if less learned has the advantage in the world of prac- 
tical affairs. 

4. 


Hamlet is normally a sensitive, good-natured person, who, 
however, during the period covered by the first four acts 
of the play, is in a state of melancholy -- a condition in- 


duced by his father's death and accompanied by a great 
lethargy. 
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Items 15 and 16 are designed to test such an objec- 
tive as "ability to recognize which facts or assump- 
tions are essential to a main thesis or to the argu- 

ment in support of that thesis." Item 16 accompa- 

nies Item 3 in a test. 


15. Statement of facts: The following table represents the relation- 
Ship between the yearly income of certain families and the med- 
ical attention they receive. 

Per Cent of Family Members 
Who Received No Medical 


Family Income Attention During the Year 


Under $1,200. 


MUT n rin 47 
$1, 200/t01$5,000 EE wie eater R 40 
$3,000. to$5;000 m Sar a ie er 28 
$5, 000. to'$10,; 000). 6) am wk n 24 
Over $10;000/7 4 X0 et ee eal 14 


Conclusion: Members of families with small incomes are health- 
ier than members of families with large incomes. 


Which one of the following assumptions would be necessary to 
justify the conclusion? 


1, Wealthy families had more money to spend for medical care, 

2. All members of families who needed medical attention re- 
ceived it. 

3. Many members of families with low incomes were not able 
to pay their doctor bills. 

4. Members of families with low incomes often did not receive 
medical attention. 


(Item 16 accompanies a reading passage in the test booklet.) 


16, Which of the following assumptions is necessary in order to de- 
termine the mass of a drop by the method described? 


l. The drop falls with uniform acceleration. 

2. All the drops sprayed into the chamber are of the same 
Size. 

The drop is charged. 

The dxop is nearly spherical. 
5. The electrical force is equal to the gravitational force. 


> w 
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Item 17, calling for analysis of the way one element 
functions in relation to others, accompanies Items 4 
and 5 ina test. 


Item 17 refers to the following paragraph: 


"For what men say is that, if Iam really just and am not also 
2 thought just, profit there is none, but the pain and loss on the 
other hand is unmistakable. But if, though unjust, I acquire 
4 the reputation of justice, a heavenly life is promised to me. 
Since then appearance tyrannizes over truth and is lord of hap- 
6  piness, to appearance I must devote myself. I will describe 
around me a picture and shadow of virtue to be the vestibule 
8 and exterior of my house; behind I will trail the subtle and 
crafty fox." 
LI 
l7. What is the function of the last sentence (lines 6-9)? The sen- 
tence 


restates the central thesis in figurative language. 
advances the premise of the argument. 

presents factual data to support the central thesis. 
contradicts the central thesis. 

introduces a new concept. 


C gu wn 


Items 18 and 19 require analysis of the relevance and 
importance of elements in an argument. They accom- 
any Items 8 and 9 in a test. 


Items 18 and 19 refer to the following situation: 


A group of college students were discussing the relative merits of 
two grading systems. It had been suggested that only two grades be 
used: 8 (satisfactory) and U (unsatisfactory), instead of the A-B-C- 


D-F system then in use at the college. One student made the follow- 
ing statement: 


"People go to college to learn, not just to get grades. Grades are 
no indication of absolute degree of learning, they are purely rela- 
tive and then mostly determined by chance or probability (guessing 
multiple-choice tests, etc.). The student is a better,judge of how 
he is doing than the professor. Therefore, an S-U system would 
be better since it would cut down the amount of differentiation be- 
tween grades and give a better picture of how the student is doing." 


18. The conclusion depends fundamentally on the proposition that 


1. people do not go to college just to get grades. 

2. the student is the best judge of how he is doing. 

3. grades are very inaccurate indications of what students 
have learned. 

one grading system is better than the other, 
multiple-choice tests are used in determining grades. 


op 
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19. Which of the following statements is least essential as a part 
of the argument? 


1. Grades are no indication of absolute degree of learning. 

2. An S-U system would cut down the amount of differentia- 
tion between grades. 

3. An S-U system would give a better picture of how the stu- 
dent is doing. 

4. Grades are determined by chance or probability. 

5. The student is a better judge of how he is doing than the 
professor. 


Items 20 and 21 are based on an excerpt from 
Lindsay's The Modern Democratic State and accom- 
pany Item 7 in a test, Thesetwo items call for analy- 
sis of relationships between elements of a communi- 
cation. Note that No. 20 requires, not merely the 
identification of an element (assumption), but a judg- 
ment concerning what assumption is essential in re- 
lation to other elements. 


20. An assumption basic to Lindsay's preference for voluntary 
associations rather than government orders (Paragraph 73) 


is a belief 


1. that government is not organized to make the best use 


of experts. 
2. that freedom of speech, freedom of meeting, freedom of 


association, are possible only under a system of volun- 


tary associations. 
3. in the value of experiment and initiative as a means of 


attaining an ever-improving society. 
4. in the benefits of competition. 


21. The relation between the definition of sovereignty given in 
Paragraph 2 and that given in Paragraph 9 is best expressed 


as follows: 


1. There is no fundamental difference between them, only a 
difference in formulation. * 

2. The, definition given in Paragraph 2 includes that given in 
Paragraph 9, but in addition includes situations which are 
excluded by that given in Paragraph 9. 

3. The definition given in Paragraph 9 includes that given in 
Paragraph 2, but in addition includes situations which are 
excluded by that given in Paragraph 2. 

4. The two definitions are incompatible with each other; the 
conditions of sovereignty implied in each exclude the 


other. 
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The following group of items is designed to test the 


objective: "Ability to recognize what particulars 
are relevant to the validation of a judgment." 


Items 22 to 26 are to be judged in relation to this resolution: 


Resolved: That the term of the President of the United States 
should be extended to six years. 


Some statements in Items 22 to 26 support the resolution, either di- 
rectly or indirectly, some could be used in arguing against the res- 
olution, and some have no bearing on the issue at all. Mark each 
statement 


22. 


23. 


24, 


25. 


26. 


LJ 
A. if you feel that it could be used by the affirmative side in a 
debate on the resolution. 
N. if you feel that it could be used by the negative side. 
X. if you feel it has no bearing on either side of the argument, 


(NOTE: You are not asked to judge the truth or falsity of the 
resolution or the statements.) 


Efficiency increases with experience. 

According to the principles upon which the United States was 
founded, the people should have a frequent check on the Presi- 
dent. 


The party system has many disadvantages. 


During most of a presidential election year the economic life 
of the nation is depressed by the uncertainty as to the outcome. 


The people should have the opportunity to keep a satisfactory 
President as long as they wish. 
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4,30 - Analysis of Organizational Principles 


27. 


28, 


29. 


The following question relates to a selection given in 
the test. Students cannot answer this question sim- 
ply by finding a statement which is true of the article 
to which the item refers. They must judge which state- 
ment best expresses the purport of the article as a 
whole; this requires analysis of the organization and 
Structure of the entire communication. 


Which one of the following is the best description of the article 


as a whole? 


1. It presents historical evidence to prove what a govern- 
ment of equal rights is like. Y 

2. It presents evidence that policies pursued in the past have 
not been consistent with the ideal of a government of equal 
rights. 

3. It presents arguments to show that certain policies pur- 
sued in the past are undesirable. 

4. It is an effort to define the true functions of government. 


Items 28 and 29 are based on a composition which is 
played during the test. No. 28 calls for analysis of the 
systematic arrangement or structure which makes the 
composition a unit. No. 29 tests such an objective as 
"ability to analyze, in a particular work of art, the re- 
lation of materials and means of production to the 
‘elements! and to the organization." 


The general structure of the composition is 


theme and variations. 

theme, development, restatement. 

theme 1, development; theme 2, development. 
introduction, theme, development. 


s CN C 


The theme is carried essentially by« 


1, the strings. 

2. the woodwinds. 
3. the horns. 

4, allin turn. 


5.00 -- SYNTHESIS 


Synthesis is here defined as the putting together of ele- 
ments and parts so as to form a whole. This is a process 
of working with elements, parts, etc., and combining them 
in such a way as to constitute a pattern or structure not 
clearly there before. Generally this would involve a recom- 
bination of parts of previous experience with new material, 
reconstructed into a new and more or less well-integrated 
whole. This is the category in the cognitive domain which 
most clearly provides for creative behavior on the part of 
the learner. However, it should be emphasized that this is 
not completely free creative expression since generally the 
student is expected to work within the limits set by particu- 
lar problems, materials, or some theoretical and methodo- 
logical framework. 


Comprehension, application, and analysis also involve 
the putting together of elements and the construction of 
meanings, but these tend to be more partial and less com- 
plete than synthesis in the magnitude of the task. Also there 
is less emphasis upon uniqueness and originality in these 
other classes than in the one under discussion here. Perhaps 
the main difference between these categories and synthesis 
lies in the possibility that they involve working with a given 
set of materials or elements which constitutes a whole in it- 
self. They involve studying a whole in order to understand 
it better. In synthesis, on the other hand, the student must 
draw upon elements from many sources and put these to- 
gether into a structure or pattern not clearly there before. 
His efforts should yield a product--something that can bé 
observed through one or more of the senses and which is 
clearly more than the materials he began to work with. It 
is to be expected that a problem which is classified as a 
task primarily involving synthesis will also require all of 
the previous categories to some extent. 


We recognize the difficulty of classifying essay questions. 
The tendency is to place them in the synthesis category. 
For example, if the student writes out his comprehension 
or analysis of a reading selection, does such a form of 
response constitute synthesis as we have defined it? If his 
essay involves analysis interms of underlying elements and 
the like, perhaps not, since he has not come out with a pro- 
duct substantially different from that which he is studying. 
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If we accept this point of view, then we would not regard 
every act of writing as an act of synthesis. We would 
assume that writing as such is primarily a skill in expres- 
sion, much of which represents the remembering of ideas, 
the interpretation of given materials, and the translation 
of ideas into writing. 


For the present, it seems best to distinguish between 
different kinds of synthesis primarily on the basis of the 
product. Such an approach does permit classification into 
three relatively distinct divisions which have some practical 
significance. Classification on the basis of product is not 
inconsistent with the taxonomy, since the “construction of 
different products may well require somewhat different pro- 
cesses. A similar assumption is made in the Knowledge 
and Analysis categories of this Handbook. 


In the first sub-category, one may view the product or 
performance as essentially a unique communication. Usu- 
ally the author is trying to communicate certain ideas and 
experiences to others, but in some instances he may be 
interested in expression for its own sake. Usually too he 
tries to communicate for one or more of the following pur- 
poses--to inform, to describe, to persuade, to impress, or 
to entertain. Ultimately, he wishes to achieve a given ef- 
fect (response) in some audience. Consequently, he uses 
a particular medium of expression, together with its forms 
and conventions, to organize certain ideas and experiences. 
The product, or outcome of the synthesis, can be considered 
"unique" in at least two respects. First, it does not 
represent a proposed set of operations or Specifications to 
be carried out, except perhaps in the narrow sense of fur- 
nishing an expressive design which may be interpreted and 
performed by an individual or group, as in the reading 
aloud of poetry, the presentation of a play, or the perform- 
ance of a musical composition. Secondly, it does not ordi- 
narily represent a contribution to our fund of tested knowl- 
edge; in fact, its relation to an external theoretical struc- 
ture is not at issue. 


In the second sub-category, one may view the product as 
a plan or proposed set of operations to be carried out. This 


may be illustrated as follows: 
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Proposed set Process—i.e., carrying Expected 
of operations out the'set of operations outcome 


Plan for an Carrying out the Experimental 
experiment experiment findings; proba- 
bility statement 


A teaching unit Teaching Changes in be- 
havior 
Specifications Building the house The house 


for a new house 


The products of Synthesis classified here thus fall in the 
first column. Clearly, each represents a kind of commu- 
nication in the sense that a particular author or worker is 
trying to tell somebody something and has recorded his 
ideas (in rare instances he may carry these ideas around in 
his head and we then have to infer them from his process of 
carrying them out). But these efforts represent more than 
communication in the sense just outlined. They represent 
an attempt to propose a set of operations. In this sense, 
products that fall in this group are incomplete; until they 
are translated into action they represent mere ideas. Or- 
dinarily, products of synthesis that fall in this second group 
must meet a set of fairly rigorous objective criteria. 


In the third sub-category, one may view the product of 
synthesis as primarily a set of abstract relations. The set 
of relations may be derived from an analysis of certain 
observed phenomena, in which case they may be considered 
possible relations, or hypotheses to be tested; or they may 
be derived from an analysis of relations among propositions 
or other symbolic representations, in which case they may 
be considered necessary relations, or deductions. The 
distinguishing feature of this sub-category is thus the at- 
tempt to derive abstract relations from a detailed analysis. 
The relations themselves are not explicit from the start 
they must be discovered or deduced. 


Related concepts andprocesses. Since certain other con^ 
cepts and processes overlap withthe synthesis category, we 
will discuss them briefly. One of these is the phenomenon 
of central organization in which the brain and nervous Sy$^ 
tem act as a vast organizing system. Some stimuli become 
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focal in consciousness, and are perceived as "figure"; 
others remain peripheral and become part of the back- 
ground; still others remain out of consciousness entirely. 
In a very real way, central organization represents a syn- 
thetic act. Because of its very pervasiveness, however, it 
would not help us draw distinctions among different forms 
of cognitive behavior, The same would be true of the pro- 
cess of "integration, the notion that every experience in- 
volves a combination of parts of previous experience with 
the present experience in such a way that the organism is 
permanently changed, however slightly. 


Often the concept of integration is discussed in terms of 
"creative learning." This raises the philosophical question 
of whether or not alllearning is "creative." In one sense, 
all learning is creative; the individual has acquired an un- 
derstanding or some other reorganization of experience 
which is novel for him. The novelty for him is what makes 
the experience "creative." Many psychologists and educa- 
tors would argue similarly, and certainly this view would 
be consistent with the theoretical framework of this taxon- 
omy. Other writers, particularly sociologists and anthro- 
pologists, would prefer restricting the meaning of "creativ- 
ity" to the production of something new, unique, and origin- 
al in man's culture--the traditional meaning. 


A concept related to "creative learning" is that of "crea- 
tive expression." The latter concept usually refers to a 
type of education which encourages self-expression on the 
part of the learner. Rich sensory experience and freedom 
to express one's whole personality are considered basic 
conditions. Although literature, fine arts, music, and drama 
seem to be the most popular media, creative expression 
need not be limited to these. Such activities represent 
synthetic processes to the extent that they require the indi- 
vidualto organige ideas into new patterns, and probably 
many of them do. However, many do not qualify because 
they emphasize expression of emotional impulses and phy- 
Sical movements, rather than organization of ideas. Prob- 
ably the main difference between "synthesis" and "creative 
expression" lies in the greater inclusiveness of the latter 


term. Whether all efforts at synthesis shall be considered 
"creative expression," however, would not seem immediately 


evident. Much would depend on the nature of the individu- 
al's motivation and how freely he gave himself to the task. 
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Educational significance of synthesis objectives. Philo- 
sophical arguments for the cultivation of synthesis objec- 
tives are numerous and need not be documented here. 
Typically, they emphasize personal expression as against 
passive participation, and independence of thought and action 
as against dependence. Personal expression is viewed as 
an end in itself; it is living at its best and fullest. Independ- 
ence of thought and action are defended largely on social 
grounds: a democratic society thrives best when its citizens 
are able to arrive at their own decisions rather than when 
someone in authority does the thinking for them. 


Arguments in terms of the needs and demands of society 
do not stop at the level of philosophical discussion. They 
emphasize real problems that face democratic countries 
here and now, and point out that we cannot expect to pro- 
gress nor even to survive unless we develop and draw upon 
the creative potentialities of the entire population. This is 
partly a problem of identifying creative talent, but it also 
is one of exploring the nature of productive thinking and of 
finding better ways of cultivating it. t 


One could cite many articles and studies which deplore 
the neglect of synthesis objectives. A fairly common theme 
is that current programs overemphasize activities in which 
the learner functions as a consumer and critic of ideas 


l Recent writing and research on creativeness and 
productive thinking (which overlap with synthetic abilities) 
attest to the importance attached to these problems by many 
psychologists and educators. The recent challenge by Allison 
Davis and others is worth noting at this point. Allison Davis 
and Robert D. Hess, "What About IQs?" Journal of the Na- 
tional Education Association 38 (Nov., 1949), pp. 604-605. 
Kenneth Eells and'others, Intelligence and Cultural Differ- 
ences, Chicago: University of Chicago Press; 1951, xii 388. 
After demonstrating that conventional intelligence tests un- 
derrate the ability of children from lower socio-economic 
levels, they conclude that we are depriving ourselves of un- 
tapped resources of human ability and robbing such children 
of their right to full development. Furthermore, because 
most pupils get limited experience in genuine problem solv- 
ing, these investigators believe that present programs retard 
pupils of low occupational groups by two years, on the aver- 
age, after they have been in school only four years! Cer- 
tainly this indictment demands serious attention. 
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rather than those in which he functions as a producer. Often 
criticism is directed against the over-use of objective-type 
examinations on the grounds that these forms do not force 

the student to produce original ideas or to organize them. 
Whether or not this argument is defensible is a matter to be 
decided by further study; in any case, however, lack of ap- 
propriate practice must surely account for many shortcom- 
ings in the development of synthesis abilities. 


The psychology of learning provides another important 
source of criteria for judging the worth of synthesis objec- 
tives. Especially important are those criteria relating to 
multiple outcomes and the permanence of learning. It is 
probable that tasks involving synthesis objectives provide 
a wider kind of experience than those involving mainly acqui- 
sition of ideas. In elementary school science, for example, 
pupils may work as a group defining important problems 
dealing with combustion, proposing hypotheses to account 
for combustion phenomena, planning simple experiments to 
test these ideas, and actually carrying out the experiments 
either individually or in small groups. Such activities 
should foster productive thinking, some independence in 
approach as well as co-operativeness, knowledge of com- 
bustion phenomena, knowledge of scientific method, and 
perhaps most important, some skill with scientific method 
as method. Over several years, experience in this form of 
learning should produce profound changes in many abilities 
and traits and at the same time contribute to the pupil's 
growth in knowledge as such. Because such experiences 
involve the relating of ideas, methods, values, etc., they 
probably foster interrelation of outcomes better than expe- 
riences which do not require genuine problem solving. And 
this inturn probably contributes to better retention and gen- 
eralization, particularly of problem-solving processes, to 
other situations. Evidence for multi-objective efficiency 
comes from such outstanding evaluation programs as the 
Wrightstone studies in New York City and the Eight-Year 
Study of the Progressive Education Association. Evidence 
on interrelation and permanence of learning is scanty but 
in agreement with the arguments outlined here. 


Especially important too are the tremendous motivational 
possibilities in synthesis activities. Such tasks can become 
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highly absorbing, more so than the usual run of school as- 
signments. They can offer rich personal satisfactions in 
creating something that is one's own. And they can challenge 
the student to do further work of a similar sort. 


Synthesis objectives occur at most levels of education. 
Some goals, such as "skill in writing" and "ability to formu- 
late hypotheses," are as appropriate at the elementary 
School level as at the Ph. D. The same may be said of the 
"ability to set a poem to music." Obviously, the tasks cor- 
responding to these objectives will differ in their magnitude 
and complexity from levelto level. We would expect a pro- 
gression from relatively small tasks to much larger tasks 
as the student moves through the educational program. Per- 
haps many synthesis objectives of the kind we have in mind 
should be postponed until relatively late in a student's edu- 
cation, especially in college and post-graduate work. But 
this matter is not well understood at present. 


5,10 Production of a unique communication 


Under this we include those objectives in which primary 
emphasis is upon communication--upon getting ideas, feel- 
ings, and experiences across to others. The important con- 
trolling or limiting factors in such tasks are the following: 
the kinds of effects to beachieved; the nature of the audience 
in whom the effects areto be achieved; the particular medium 
through which the student expresses himself; and the parti- 
cular ideas and experiences that the student can draw upon 
or that he wishes to communicate. 


By "effects" we mean the response or change in response 
desired in some audience. This would include such outcomes 
as the following: the acquisition of information; the under- 
Standing of an idea, point of view, etc.; the acceptance of 
an idea, point of view, etc.; motivation to carry out a pur- 
pose that the author has in mind; change in attitude or belief; 
the creation of a mood or feeling; enjoyment or emotional 
satisfaction. 


The nature of the audience to whom the student addresses 
himself or his work is often crucial in determining what he 
does. This is likely to be the case whenever he must ex- 
press himself to à specific audience, as against one that is 
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rather loosely defined or not physically assembled. In some 
cases, however, it is likely that the student need not take 
into account any special audience; he carries out the task 
according to certain minimum standards that will be applied 
by those who will evaluate his work. 


Obviously, a key part in such assignments is the effec- 
tiveness with which the student uses the particular medium 
of expression, together with its forms and conventions, to 
translate and to organize his ideas. The point is that the 
particular medium also sets limits within which the student 
must accomplish the purposes set by the task. 


The product of synthesis is also rendered unique because 
of the great latitude allowed the individual in putting his 
own ideas, feelings, and experiences into it. In other 
words, much of the content of the synthesis is not rigor- 
ously predetermined by the requirements of the task; it 
flows from the person and is used by him if he alone deems 
it worthy of incorporating in his work. Of course, as we 
Said earlier, this is not completely free expression since 
the student must still meet certain minimum requirements 
Such as those set by convention and by the other conditions 
outlined above. 


5.10 Production of a unique communication--Illustrative 


educational objectives. 


Skill in writing, using an excellent organization of 
ideas and statements. 


Ability to write creatively a story, essay, or verse 
for personal pleasure, or for the entertainment or 
information of others. c 

Ability to fell a personal experience effectively. 


Ability to make extemporaneous speeches. 


Ability to write simple musical compositions, as 
in setting a short poem to music. 
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5.20 Production of a plan, or proposed set of operations 


Objectives that fall in this sub-category in general aim 
at the production of a plan of operations. The production of 
the plan constitutes the act of synthesis. What happens 
after the production of the plan is another matter; the plan 
of operations might very well be carried out in parts by 
several individuals. 


The product, or plan of operations, must satisfy the re- 
quirements of the task. Usually the requirements are laid 
down in the form of specifications or data to be taken into 
account by the student. These data or specifications may 
be given the student, in which case he may assume that they 
are sound, or they may have to be worked out by him before 
he can proceed. But in any case, the specifications do fur- 
nish a rather well-defined criterion against which the stu- 
dent's product may be evaluated. In this sense, his product 
must always meet an empirical test of its soundness. 


Although the student must meet such empirical require- 
ments, this does not mean that there is no room for the 
"personal touch," or that values have no place in his work. 
Here too, as with the previous sub-category, there is con- 
siderable opportunity for the student to put his own ideas 
into the product, apart from any other considerations. Even 
the most limiting kind of purpose, such as the testing of a 
specific hypothesis, still permits the student to conceive of 
a way of accomplishing it that is uniquely his own. In many 
tasks that fall in this sub-category, values also enter the 
picture. They are reflected in the specifications or other 
data with which the student works, but ultimately reside 
in the purposes to be served by the outcome of the plan. 


5.20 Production of a plan, or proposed set of operations-- 


Illustrative educational objectives. 
Ability to propose ways of testing hypotheses. 


Ability to integrate the results of an investigation 
into an effective plan or solution to solve a problem. 
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Ability to plan a unit of instruction for a particular 
teaching situation. 


Ability to design simple machine tools to perform 
specified operations. 


Ability to design a building according to given 
specifications. 


Ability to synthesize knowledge of chemistry, 

knowledge of the unit operations, and data avail- 
able in the technical literature, and apply these 
to the design of chemical processes. (Chemical 
engineering. ) 


5.30 Derivation of a set of abstract relations 


In this sub-category we include objectives that require 
the student to produce, or derive, a set of abstract rela- 
tions. There seem to be two somewhat different kinds of 
tasks here: (1) those in which the student begins with con- 
crete data or phenomena and which he must somehow either 
classify or explain; (2) those in which the student begins 
with some basic propositions or other symbolic representa- 
tions and from which he must deduce other propositions or 
relations. 


The first of these types of tasks may take the form of 
classifying certain phenomena. In effect, the student is to 
study the phenomena, or facts based upon them, and then 
come up with a logically consistent scheme for classifying 
or organizing them. The scheme should adequately account 
for the relations existing among the range of phenomena. At 
a very high levei, one can offer as examples the development 
of the periodic table in chemistry in which the various chem- 
ical elements have been grouped according to their funda- 
mental properties, or the development of the taxonomies for 
classifying plants and animals, respectively, again according 
to their fundamental properties. Also at a high level--but 
Suitable for the graduate student in educational psychology-- 
would be the derivation of a conceptual scheme for categoriz- 
ing teacher-pupil interaction during classroom discussions. 
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The first type of task may also take the form of explain- 
ing certain observed phenomena. In this case, there is little 
emphasis upon developing a classification scheme. The 
problem is to formulate a hypothesis that will adequately ac- 
count for a wide range of seemingly interrelated phenomena. 
As with a classification scheme, the hypothesis or theory 
must fit the facts and in addition be internally consistent-- 
i.e., free from logical contradictions. 


The second broad type of task clearly begins with abstract 
symbols, propositions, and the like, rather than with con- 
crete data. The^'problem is to move from these symbolic 
representations to deductions that can reasonably be made. 
In other words, the student operates within some theoretical 
framework, and he must reason in terms of it. He is thus 
quite circumscribed in what he does, although the task can 
permit him to carry his thinking quite far. But always in 
the background are rigorous objective criteria which his 
product of synthesis must meet; subjective standards, of the 
sort that predominate in the first and second sub-categories, 
all but vanish here. 


5.30 Derivation of a set of abstract relations--Illustrative 
educational objectives. 


Ability to formulate appropriate hypotheses based 
upon an analysis of factors involved, and to modify 
such hypotheses in the light of new factors and 
considerations. 


sae . 
Ability to formulate a theory of learning applicable 
to classroom teaching. . 


Ability to perceive various possible ways in which 
experience may be organized to form a conceptual 
Structure. 


Ability to make mathematical discoveries and 
generalizations. 
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Testing for Synthesis, and illustrative test items 
Special Problems 


A major problem in testing for synthesis objectives is 
that of providing conditions favorable to creative work, This 
problem is not peculiar to synthesis objectives, but it does 
seem to be more crucial than with some of the other objec- 
tives. Perhaps the most important condition is that of free- 
dom. This should include freedom from excessive tension 
and from pressures to adopt a particular viewpoint. The 
student should be made to feel that the product of his efforts 
need not conform to the views of the instructor, or the com- 
munity, or some other authority, if such freedom is other- 
wise consistent with the nature of the task. If the effort is 
to be rather creative, the student should also have consider- 
able freedom of activity--freedom to determine his own pur- 
poses, freedom to determine the materials or other elements 
that go into the final product, and freedom to determine the 
specifications which the synthesis should meet. Creativity 
seems to be fostered by such conditions, Too much control 
and too detailed instructions, on the other hand, seem to 
stifle productivity, Time is another important condition, 
Many synthesis tasks require far more time than an hour or 
two; the product is likely to emerge only after the student 
Spends considerable time familiarizing himself with the task, 
exploring different approaches, interpreting and analyzing 
relevant materials, and trying out various schemes of organ- 
ization. In some situations, the examiner can shorten this 
period of preparation by permitting the student to do many of 
the preliminary tasks before the time of the examination, if 
Such an arrangement does not otherwise interfere with the 
validity of the examination. A good example is the essay 
exercise outlined on pages 177 and 178, In that case, the ex- 
aminer may distribute the Special reading materials well in 
advance of the examination so that students will have had 
sufficient time to analyze them and become familiar with the 


important ideas. 


A second major problem is that of sampling. Again this 
problem seems to be especially crucial in the testing of 8yn- 
thesis objectives. For one thing, many synthesis tasks take 
time--days and weeks instead of hours—so that a single prod- 
uct usually may have to represent the student's ability. Under 
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such conditions, of course, the examiner must consider 
whether or not that sample is sufficiently reliable to be ac- 
cepted as truly representative of the student's ability. Ob- 
taining a second sample, however, in itself poses many 
practical problems which the examiner may not be able to 
surmount. It is probable too that some synthesis tasks in- 
volving a high degree of creativeness require special condi- 
tions of stimulation, mood, fluency, and the like, and that 
such conditions tend to make performance rather variable 
if not downright unstable. Synthetic skills and abilities may 
thus be rather unstable and unpredictable. 


A third major problem is that of evaluation. Exercises 
involving synthesis often yield rather complex products for 
which objective criteria of evaluation are lacking. A new 
poem, a new musical piece, or a new design may defy evalu- 
ation. Who is to pass judgment on the quality of the product 
and by what standards? In the absence of an objective stand- 
ard such as an external framework, theory, or the like, the 
examiner may have to rely heavily upon the opinions of com- 
petent judges. Check lists and rating scales should be es- 
pecially useful here, but the examiner ought to insure that 
they do not emphasize elements of the product to the neglect 
of global qualities which, after all, may be more fundamen- 
tal in any synthesis. 


At this point we might note the projective character of 
many products of synthesis. While it is true that most 
behavior is projective in the sense that the individual un- 
consciously or otherwise reveals idiosyncrasies, situations 
undoubtedly vary greatly in the extent to which they evoke 
such traits. Tasks calling for synthesis of materials, ideas, 
and the like would seem to provide an excellent means of 
encouraging projection. The writing of an essay, for ex- 
ample, is more than an expression of skill in writing; it is 
an expression of the writer's personality. Thus it may re- 
veal not only peculiarities of language usage, but also atti- 
tudes toward various issues, feelings about the self, and 
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so on. The product bears the stamp of the person, 2 
Clinical psychologists have long been interested in such 
personal products as a means of studying personality, but 
instructors make comparatively little systematic use of 
them for that purpose. It is probable that educational re- 
search will make increasing use of personal products as a 
method of studying personality development and various 
subtle changes that take place during the course of learning. 
Such efforts will call for refinements in our methods of 
appraisal. 


A fourth major problem worth noting is the practical 
problem of administration. Special materials and equip- 
ment are often necessary, even when the examination is 
administered to a group. A synthesis task in architectural 
design or musical composition would require individual 
equipment toa greater extent than would be needed for tasks 
involving analysis. Materials to be used for analysis by a 
class can often be printed, recorded, or otherwise repro- 
duced so thatthe entire group may work with a single speci- 
men or copy. In many cases, too, exercises calling for 
synthesis can only be properly administered onan individual 
basis, and this practice is quite costly. 


Occasionally examiners have resorted to indirect methods 
of testing synthesis objectives. For example, some publish- 
ed tests attempt to measure effectiveness of expression, 
particularly ability to organize ideas, through multiple- 
choice items. Thus the test may ask the student to rearrange 
a group of sentences to form a coherent paragraph, or a 
group of paragraphs to form a coherent essay. If such in- 
direct methods can be shown to yield valid indexes of the 
behaviors in question, then some of the practical problems 
of administration can be overcome‘ and economies can be 
realized. 


« 


2 Studies by Allport and others have shown that style of 
writing is rather consistent and can be identified with con- 
siderable accuracy. Cf. F.H. Allport, L. Walker, and E. 
Lathers, "Written Compositions and Characteristics of Per- 
sonality," Archives of Psychology, 26, (1934), No.173, p.82. 
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Thus we recognize that short-answer questions may not 
be testing synthesis directly, even though they are intended 
to evoke the sorts of operations we would regard as acts of 
synthesis. It is quite possible that short-answer questions 
may indirectly appraise such abilities. Whether or not they 
can is, of course, an empirical matter. At the present 
time, we cannot give a generalization on this point. Only 
further research can do that. 


Types of Errors 


In general, a synthesis is faulty to the extent that it lacks 
"goodness of fit" to the requirements of the problem. Faulty 
synthesis may be due to one or more of the following factors, 
many of which seem to reflect faulty comprehension and 
analysis: 


Misinterpreting the purpose or nature of the problem. 
Misinterpreting the nature of important elements and 
their interrelations. Confusing basic and subordinate 
elements. 

Omitting important elements. 

Applying irrelevant or inaccurate elements. 
Over-organizing the synthesis, so that the result is too 
artificial or inflexible to satisfy varying requirements, 


as with a plan of investigation or an architectural design. 


Otherwise failing to satisfy the requirements of an ex- 
ternal theory, framework, or of some other standard. 


e 
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5.00 - SYNTHESIS -- ILLUSTRATIVE TEST ITEMS 


5.10 Production of a unique communication 


Directions for the Essay 
Time: 3 hours) 
1. (Note: Students were given a number of short Passages dealing with 
the problem, ) 


DIRECTIONS: Write a unified paper on some restricted aspects of the 
question of the future of private property in America. The paper may 
be either an argument in support of some form of ownership which you 
favor, or an attack upon some form which you oppose, or both. It must, 
however, observe the following stipulations: 


It must include a discussion of the moral bases and social effects 
of the kind of ownership which you favor or wish to.attack, For example, 
what ultimate right has anyone to claim anything ‘as his own? What 
should he be allowed to do with what he owns? How should such rights 
be achieved, or protected, or limited? What will be the effects on so- 
ciety of the policies which you discuss? 


It must relate your thesis to the arguments pro and con of the 
passages distributed before the examination which are relevant to your 
position. It must not merely report what these passages said in the 
order in which they were printed. In the course of developing your own 
position you must make use of the arguments which support it and refute 
the arguments which oppose it. 


It must show some application of your theoretical position to one 
or more examples of property rights drawn from your own experience, 
observation, or reading. The following examples may suggest possi- 
bilities: private property in the family, or in the dormitory; rented, 
owned, and cooperative housing; public and private schools; independent, 
chain, and cooperative stores; making the University Bookstore a co- 
operative; municipal ownership of utilities and transportation; nationali- 
zation of banks, coal mines, railroads, and communications; national 
developments such as TVA; the rights of capital, management, labor, 
and consumers in the control of large corporations, etc. 


In form, the paper must be an argument. It must not be a mere 
assertion of your opinions supported by a description of the practices 
which you favor. It must give reasons for the position which you favor 
and against the positions which you oppose. The reasoning must be 
logical, but it need not make explicit reference to logical forms. 


The argument should be clear, interesting, and acceptable to the 
audience to which it is addressed. In a preliminary paragraph, separate 
from the rest of the paper, describe briefly the traits of your audience 
which you intend to keep in mind while writing your paper. 


The paper must be effectively organized and well written. It must 
not follow the points given above as a writing outline. It must not ignore 
them, however. Students are expected to deal with the assignment. 
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The nature of the opinions expressed in this paper will have no 
effect on grades, and will never be revealed. Papers will be read only 
by members of the English 3 staff, and only after the names of the 
writers have been removed. 


It will be wise to spend about half an hour thinking about the as- 
signment and planning the paper, and to reserve half an hour at the end 
to read over and revise what you have written. Do not attempt more 
than you can treat adequately in two hours of writing. A careful limita- 
tion of the scope of the paper is one mark of a good essay. The exami- 
nation booklet has been enlarged; if possible, confine your essay to one 
booklet. The first pages may be used for notes, an outline, or a rough 
draft; but draw lines through this material to indicate that it is not part 
of the finished essay. Please write in ink, and as legibly as you can. 
Since there will not be time to make a fair copy of the essay in its final 
form, portions may?be crossed out and corrections inserted between the 
lines and in the margins, but please make the corrections as clearly 
and neatly as possible. Dictionaries may be used, and any notes which 


you have written on your copy of the Passages for Study. 
se 


The preceding exercise qualifies as a synthesis task because the 
student must achieve a novel organization of ideas. While he may 
have many ideas on the topic, and these may represent a consistent 
viewpoint, he probably cannot produce from memory a coherent ar- 
gument which will satisfy the specific stipulations of this assignment. 
He must relate his argument to some specific reading passages dis- 
tributed before the examination; he must apply knowledge drawn from 
his own experience; he must consider related problems; and he must 
develop a reasoned position with a specific audience in mind. In other 
words, he must undertake a detailed analysis before he can begin to 
organize his ideas into a coherent argument. 


2. The following exercises can be used to test the ability to make up 
short Stories. Each may be given as an oralor written exercise, with 
or without much preparation on the part of the storyteller. 


4 "Think of some time in your own life when you were up against a 
difficulty; something that stood in your way and had to be overcome. 
Make up a story around this difficulty and tell it to the class." 


"Think of a plot based upon an obstacle that could occur between the 
following two sentences, and then develop a short, story using these 
sentences and your plot." 


It was an event to be honored with a party, preferably a 
surprise party... "It was a surprise, all right--a sur- 
prise all the way around! " 

oook 


Here the student draws upon past experience for suitable ideas. He 
must produce and organize these to achieve such effects as build-up 
and climax. 
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3,The exercises below can be used to test the ability to write poetry. 
The student may be given a line and asked to complete a verse, or 
he may be given a verse and asked to write a second verse. 


"I saw old autumn in the misty morn" ? (Add three lines to com- 
plete this verse.) 


"Shining like slugs, 


The cars came fast; (Finish this description 
Across the night of cars at night by add- 
Their glances glowed; ing two lines.) 


With purring hearts, 
Approached and passed" 


"Men cannot swim (Add a second verse of 
As fishes do, four lines. ) 
They only slave 


" 
A hard way through. oon 


Here also the student must achieve a novel organization of ideas. 
He must produce and organize them to form a whole consistent with 
the parts already given. 


4. A variety of exercises ranging from the fairly simple to the fairly 
complex can be used in the schools to test ability to compose music: 


Set a poem to music. (An appropriate one can be furnished the 
student. ) 


Write a simple melodic line. 
Write a composition with a single tonal base. 
Write a composition using two tonal levels. 


Write a specific work in a larger form for any of the accepted medi- 
ums of expression such as a chamber group, orchestra, chorus, or 
piano. The composition should be of at least ten minutes' duration 
and have received performance. Suggested designs are as follows: 
a string quartet, a trio, or a sonata for violin or violoncello and 
piano, or a work for full orchestra, or a dramatic work or a cantata 
for solos, chorus, and orchestra of at least fifteen minutes! duration. 
(Thesis requirement for master's degree in music. ) 
Jootok 


All of these exercises seem to qualify as synthesis tasks. They 
require a novel product--something that the student cannot produce as 
a whole from memory. While the elements in this case are musical 
tones, and thus seem to be sensory in character, their arrangement 
into combinations of tones and themes seems to represent a genuine 
intellectual effort. The process of composing seems to involve the 
testing of tones and combinations of tones against each other, as well 

3R. M. W. Travers, "The Evaluation of the Outcomes of Teaching 
in English," Journal of Experimental Education, Vol. XXVII, 1948, 
pp. 325-333. 
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as against the requirements of a particular type of music. In the 
case of the first exercise above, the composer must comprehend the 
elements in the poem--particular ideas, moods, etc.,--and try to 
embody them in his music, When such a stimulus is not furnished, 
of course, the composer must draw these elements from his own 
experience. 


5.20 Production of a plan, or proposed set of operations 


5, Several authorities were asked to participate in a round table dis- 
cussion of juvenile delinquency. They were given the following data 
about City X and for three of the communities, A, B, and C within 
City X. 


2 For City X For Com- For Com- For Com- 
as a whole munity A munity B munity C 


Juvenile Delinquency Rate 
(annual arrests per 100 
persons aged 5-19) 4.24 18.1 1.3 4.1 


Average Monthly Rental $60. 00 $42.00 $100.00 $72.00 


Infant Death Rate (per 
1000 births) 52.3 76.0 32.1 56.7 


Birth Rate (per 1000 
inhabitants) 15.5 16.7 10.1 15.4 


In addition, they were told that in Community A the crimes against 
property (burglary, etc.) constituted a relatively higher proportion of 
the total juvenile offenses than in Communities B and C, where crimes 
against persons (assault, etc.) were relatively greater. 


(1) How would you explain the differences in these juvenile delinquency 
rates in light of the above data? (You may make use of any theory or 
material presented in the course.) 


(2) In light of your explanation of the data what proposals would you 
make for reducing the juvenile delinquency rate in each of the three 
communities ? : 


okk ò 


Conceivably, both questions of this exercise could qualify as pri- 
marily synthesis tasks. The first might be considered as a demand 
for hypothesis formulation, provided the phenomena reported upon have 
not been previously studied. Ordinarily, however, this task would 
represent application of generalizations acquired in social studies 
courses. The response to the second question would depend closely 
on the kind of explanation given to the first, The first question sets 
the framework within which the student makes his proposals. Again, 
if proposals have not been developed in a course, the student must 
produce some which are consistent with his analysis of factors asso- 
ciated with delinquency. It is this process of selecting and organizing 


181 


means (courses of action) in relation to the desired ends (control or 
reduction of delinquency) that qualifies the task as synthesis. 


6, Design a simple drill jig for performing the last operation in the 
production of the part shown in the accompanying drawing. The last 
operation is to "drill all holes," One thousand parts only are to be 
made and XLO bushings 1/2" O.D. and 1/2" long are to be used. 4 
(Design not shown) 


This exercise represents synthesis because the student must com- 
bine two sorts of elements to produce a novel product: (1) specifica- 
tions for the device, and (2) principles of design. The student has 
some freedom in designing the device, provided it will perform the 
required job satisfactorily. . aie 

e 
7. A Problem in Chemical Process Design " 


The following problem was used ina course in chemical engineer- 
ing. The student must prepare a process design which meets the 
Specifications outlined in the accompanying letter. 


AJAX PETROLEUM CORPORATION 
Office of the Chief Engineer 


March 5, 1951 


To Process Engineering Division: 


Our management has decided to increase the output of aviation gaso- 
line base stock from our East Chicago Refinery. The only major addi- 
tion to the refinery necessary will be a butane isomerization unit. The 
engineering schedule requires that the process engineering and cost 
estimate must be completed and the information transmitted to the 
Mechanical Engineering Department by April 4, 1951. The process 
design should be in our usual report form and include a flow diagram, 
utilities required, equipment specifications, instrumentation, and draw- 
ings of the plot plan and elevation. The isomerization process is to be 
selected by you, and your choice should be supported by adequate argu- 


ments and description. 
e 


Will you please proceed according to your best judgment based upon 
the attached conditiéns. 
Very truly yours, 


AJAX PETROLEUM CORPORATION 


f From The Measurement of Understanding, The Forty-Fifth Mecum 
bookof the National Society for the Study of Education, Part I, Chicago: 


The University of Chicago Press, 1946, pp. 299-300. m 
This problem and an accompanying check list were developed by 


E. Rosenthal, Brooklyn Technical High School. 
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A Problem in Chemical Process Design (continued) 
Ajax Petroleum Corporation 
1000 BFSD Butane Isomerization Unit 
East Chicago, Illinois ^ 
Job. 774 


Site: 175 feet x 150 feet, level at NE corner of catalytic unit. 
Soil bearing load 3000 Ibs. /sq. ft. 6 feet below grade. 


Feed Stock: 
Source: De-ethanized catalytic cracker gas. 


Pressure: 275 psig at battery limits. 
, 


Composition: lbs./hour 
ethane 30 
propane 2850 
iso-butane 4560 
n-butane 845 
pentane 750 
propylene 80 
butylenes 140 
water saturated 


Yield: 1000 bbl./stream day 98% isobutane 
Storage: 30 days product storage required 


Utilities: water: available at 40 psig 


7120F maximum summer temperature 


37 F minimum winter temperature. 


Electricity: 110 v Single phase and 220/440 3 phase. 


Steam: 250 psig - 50°F superheat 
5 psig - saturated 


HORI 
+ 

This problem involves synthesis of a number of elements: steps 
in the chemical process, conditions of operation, "utilities required, 
equipment specifications, and instrumentation. Some of these elements 
are given the student; others he must determine through proper analy- 
sis and through application of principles. He must consider the above 
elements in relation to one another and to the requirements of the pro- 
cess design, and he must support his solution by adequate arguments. 
While analysis and application enter this exercise to a great extent, 
the student must organize a variety of ideas in order to accomplish 
the design. 
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5.30 Derivation of a set of abstract relations 


8, Facts: Dry gases X and Y react readily when mixed in a glass flask. 
If, however, just before the gases are introduced, the flask is heated 
strongly and cooled, no reaction takes place. If a copper container is 
used, no reaction occurs. 


DIRECTIONS: Consider each hypothesis below in the light of the facts 
above. If the hypothesis is untenable or is not stated in a way that could 
be tested experimentally, blacken answer space A. Otherwise choose 
the experiment which will best test the hypothesis and blacken the appro- 
priate answer space. 


Water is a necessary participant in the reaction. 


A- Hypothesis is not tenable or cannot be tested experimentally, 

B- Dry the flask without heating it before introducing the gases. 

C- Leave the flask open after mixing the gases. 

D- Moisten the walls of the copper container before introducing 
the gases. 

E- Heat the glass flask strongly, allow it to cool, and leave it 
open for several days before introducing the gases. 


Copper forms a stable compound with the gas X and prevents reac- 
tion with the other gases. 


A- Hypothesis is not tenable or cannot be tested experimentally. 

B- Inspect the interior surface of the copper container with a 
high-power microscope. 

C- Increase the concentration of gas X in the copper container 
and note whether the reaction begins, 

D- Moisten the walls of the copper container before introducing 
the gases. 

E- Coat the interior with paraffin. 


The reaction takes place by a simple collision of X and Y molecules 
in the body of the gas. 


A- Hypothesis is not tenable or cannot be tested experimentally. 

B- Carry out the reaction in a glass container whose interior is 
lined with copper. 

C- Carry out the reaction with gases Xeand Y dissolved in water, 

D- Cover the interior of the flask with paraffin. 

E- Increase thê gas concentrations of gas X in a glass flask and 
note whether the rate finally reaches a constant limiting value, 


The preceding seems to involve synthesis in that the student must 
relate several ideas. He must first of all draw some inferences to 
account for the given phenomena--e.g., the reaction failed to take 
place because heating drove off a necessary agent--water; or,because 
heating affected the chemical condition of the glass in some way. For 
question 1, he must ignore this second possibility by choosing an 
experiment which tests solely the effect of water, This operation, 


Ee 
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incidentally, involves the application of an abstraction--the concept of 
experimental control. But the application occurs as a part of this 
process of relating a number of ideas to account for the given mate- 
rials, in this case, report of some specific physico-chemical phenom- 
enon, In addition, the student must synthesize further by considering 
some other hypotheses. 


9. The formulation of reasonable hypotheses E A housing concern 

has made some experiments on methods of heating houses. A room was 
constructed with walls that could be heated or refrigerated at the same 

time that air of any temperature was being circulated through the room. 
Several individuals were asked to record their sensations as the condi- 
tions were varied as follows: 


Wall Air 
Trial Temperature Temperature Sensations 
1 859 859 Uncomfortably hot 
2 859 509 Uncomfortably hot 
3 709 850 Comfortable 
4 70° 709 Comfortable 
5 709 50° Comfortable 
6 50° 509 Very cold 
7 509 70° Uncomfortably cold 
8 50° 85° Cold 


How can you explain the sensation of "coldness" by a person in a 
room where the air temperature is 85° and the wall temperature is 50° 
{all temperatures Fahrenheit)? Consider the following questions and 
organize your thinking under the outline given below. 


a) Make all the suggestions you can which you believe will explain why 
a person is cold in a room where the air temperature is 85° and the 
wall temperature is 50°. Give your reasons as to why you believe 
each of these suggestions wili explain the phenomenon. 


b) What kinds of evidence would you want to collect which would enable 
you to decide among your suggested hypotheses? 


c) Now go over the suggestions which you have made above and select 
the one which you believe to be the "best" explanation and give your 
reasons for your selection. 


aK g 


This exercise is similar to the preceding one. It, too, requires 
that the student relate a number of ideas to explain a phenomenon. 
Question c) involves evaluation as defined in this Handbook. 


—MMHLL—————— ‘ y 
Adapted from The Measurement of Understanding, The Forty-Fifth 
Yearbook of the National Society for the Study of Education, Part I, 


Chicago: The University of Chicago Press, 1946, p. 118. 
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6.00--EVALUATION 


Evaluation is defined as the making of judgments about 
the value, for some purpose, of ideas, works, solutions, 
methods, material, etc. It involves the use of criteria as 
well as standards for appraising the extent to which parti- 
culars are accurate, effective, economical, or satisfying. 
The judgments may be either quantitative or qualitative, 
and the criteria may be either those determined by the stu- 
dent or those which are given to him. 


Evaluation is placed at this point in the taxonomy be- 
cause it is regarded as being at a relatively late stage ina 
complex process which involves some combination of all 
the other behaviors of Knowledge, Comprehension, Appli- 
cation, Analysis, and Synthesis. What is added are criteria 
including values. Evaluation represents not only an end 
process in dealing with cognitive behaviors, but also a ma- 
jor link with the affective behaviors where values, liking, 
and enjoying (and their absence or contraries) are the cen- 
tralprocesses involved. However, the emphasis here is 
still largely cognitive rather than emotive. 


Although Evaluation is placed last in the cognitive do- 
main because it is regarded as requiring to some extent all 
the other categories of behavior, it is not necessarily the 
last step in thinking or problem solving. It is quite possi- 
ble that the evaluative process will in some cases be the 
prelude to the acquisition of new knowledge, a new attempt 
at comprehension or application, or a new analysis and 
Synthesis. 


Man is apparently so constituted that he cannot refrain 
from evaluating, judging, appraising, or valuing almost 
everything whiclf comes within his purview. Much of this 
evaluating is highly egocentric in that the individual judges 
things as they relate to himself. Thus, ideas and objects 
which are useful to him may be evaluated highly, while ob- 
jects which are less useful to him (but which may be ex- 
tremely useful to others) are evaluated less highly. Al- 
though utility is an important criterion for the individual's 
evaluations, familiarity, lack of threat to self, status con- 
siderations, and ease of comprehension may also form 
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criteria for judgments which are no less egocentric than 
utility. 


For the most part, the evaluations customarily made 
by an individual are quick decisions not preceded by very 
careful consideration of the various aspects of the object, 
idea, or activity being judged. These might more properly 
be termed opinions rather than judgments. Customarily, 
opinions are made at less than a fully conscious level and 
the individual may not be fully aware of the clues or bases 
on which he is forming his appraisals. For purposes of 
classification, only those evaluations which are or can be 
made with distinct criteria in mind are considered. Such 
evaluations are highly conscious and ordinarily are based 
on a relatively adequate comprehension and analysis of the 
phenomena to be appraised. It is recognized that this may 
be far from the normal state of affairs. It is, however, 
based on a recognition that educational procedures are in- 
tended to develop the more desirable rather than the more 
customary types of behavior. 


Although it is recognized that an individual is, on many 
grounds, entitled to his own opinion as well as his own 
judgments about the value of specific ideas, objects, or 
activities, one major purpose of education is to broaden the 
foundation on which judgments are based. Thus, it is anti- 
cipated that as a result of educational procedures, individu- 
als will take into consideration a greater variety of facets 
of the phenomena to be evaluated and that they will have in 
mind a clearer view of the criteria and frames of reference 
being used in the evaluation. 


One type of evaluation can be made largely on the basis 
of internal standards of'criticism. Such internal standards 
are for the most part concerned with tests of the accuracy 
of the work as judged by consistency, logical accuracy, and 
the absence of internal flaws. It is recognized that even 
when a document, product, or work is perfectly accurate or 
consistent on the basis of internal standards, it does not 
necessarily constitute a work which can be valued highly 
unless it also satisfies certain external standards. A sec- 
ond type of evaluation may be based on the use of external 
Standards or criteria derived from a consideration of the 
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ends to be served and the appropriateness of specific means 
for achieving these ends. Such evaluations are primarily 
based on considerations of efficiency, economy, or utility 
of specific means for particular ends. This type of evalua- 
tion also involves the use of particular criteria which are re- 
garded as appropriate for members of the class of phenom- 
ena being judged, i.e., in terms of standards of excellence 
or effectiveness commonly used in the field or in a compari- 
son of particutar phenomena with other phenomena inthe 
same field, 
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6.10 Judgments in terms of internal evidence 


Evaluation of a communication from such evidence as 
logical accuracy, consistency, and other internal criteria. 
Formal education in a democracy has generally been ex- 
tremely cautious in dealing with problems of evaluating, 
especially in the social sciences and, to some extent, in 
the humanities and natural sciences. Undoubtedly, this is 
in large part dictated by the fear that the schgol might be 
doing special pleading before the individual is really mature 
enough to be fully informed about alternatives. It is also 
dictated by a belief that in a democracy each citizen is ex- 
pected--especially on political problems--to consider the 
major alternatives and then make his own decision. Asa 
result of this caution, evaluation objectives in the schools 
have largely emphasized judgments about accuracy, usually 
with reference to internal standards such as consistency, 
logical accuracy, and the absence of particular internal 
flaws. 


After an individual has comprehended and perhaps ana- 
lyzed a work, he may be called upon to evaluate it in terms 
of various internal criteria. Such criteria are for the most 
part tests of the accuracy of the work as judged by the logi- 
cal relationships evident in the work itself. Has the writer 
(or speaker) been consistent in his use of terms, does one 
idea really follow from another, and do the conclusions 
follow logically from the material presented? There are 
other internal standards which may be used to determine 
that there are no major errors in the treatment or report- 
ing of data and that statements are made with some preci- 
Sion or exactness. It is also possible to judge a work to 
determine whether the manner in which the writer cites 
Sources or documents or the care with which particulars 
are given is likely to yield a high probability of accuracy. 


| 


| 
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Evaluation--Illustrative educational objectives 
6.10 Judgments in terms of internal evidence 

Judging by internal standards, the ability to assess 

general probability of accuracy in reporting facts 


from the care given to exactness of statement, doc- 
umentation, proof, etc. 


The ability to apply given criteria (based on internal 
standards) to the judgment of the work. 


The ability to indicate logical fallacies in arguments. 
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6.20 Judgments in terms of external criteria 


Evaluation of material with reference to selected or 
remembered criteria. --The criteria may be ends to be 
satisfied; the techniques, rules, or standards by which such 
works are generally judged; or the comparison of the work 
with other works in the field. This type of evaluation in- 
volves the classification of the phenomena in order that the 
appropriate criteria for judgment may be employed. Thus, 
a work of history is to be judged by criteria relevant to 
historical works rather than to works of fiction. A rhetori- 
cal work is to be judged by criteria relevant to such works 
rather than criteria appropriate to different kinds of verbal 
presentations. Jüst so, a work of art may be judged by 
many different criteria, depending upon the classification 
of the work, e.g., representational, expressional, as com- 
municating a particular message or idea, etc. All of this 
involves the assumption that each phenomenon is a member 
of a class and is to be judged by criteria which are appro- 
priate to that class. This also includes the possibility of 
comparing a work with other members of the same class of 
work. 


It should be pointed out that the classification of a work 
and the evaluation of it in terms of the criteria appropriate 
to the class involve some relatively arbitrary judgments. 
Clearly a work is at one and the same time a member of 
many different classes. Thus, an historical work may also 
be a rhetorical, philosophical, or even poetic work. The 
decision as to the class in which it is to be evaluated does 
not preclude it from being also evaluated as a member of 
another class. 


Quite frequently the external criteria are derived from 
a member of the class which is considered to be a model 
member in some respects (not necessarily the ideal or best 
member). This may result in the judgments focusing on the 
comparison of the two members of the class rather than on 
the extent to which one member satisfies selected abstract 
criteria. 


. This type of evaluation may also involve the classifica- 
tion of a work with regard to the ends to be achieved by the 
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work, followed by a judgment as to whether the means used 
are appropriate to the ends in terms of efficiency, economy, 
and utility. This involves the assumption that particular 
means serve some specific ends better than others, and that 
particular ends are best served by some specific means. It 
should be recognized that the major problem in many judg- 
ments of this kind is what ends are to be considered. The 

ends may be those conceived by the originator of the work 
or idea, or they may be those deemed appropriate by the 

critic. It should also be recognized that a particular work 
or idea may be evaluated in terms of many different means- 
ends relationships. This may require the answering of the 
following questions: Do the means empleyed represent a 

good solution to the problem posed by the ends desired? 

Are the means the most appropriate ones when the alterna- 
tives are considered? Do the means employed bring about 
ends other than those desired? 


Evaluation--Illustrative educational objectives 
Judgments in terms of external criteria 


The comparison of major theories, generalizations, 
and facts about particular cultures. 


Judging by external standards, the ability to compare 
a work with the highest known standards in its field-- 
especially with other works of recognized excellence, 


Skills in re&ognizing and weighing values involved in 
alternative courses of action. 


The ability to identify and appraise judgments and val- 
ues that are involved in the choice of a course of ac- 
tion, 


The ability to distinguish between technical terminol- 

ogy which adds precision to a text by permitting more 
appropriate definition of terms, and that which merely 
replaces a common name by an esoteric one. 


The ability to evaluate health beliefs critically. 
The ability to apply self-developed (aesthetic) stand- 


ards to the choice and use of the ordinary objects of 
the everyday environment. 


a 


Testing for Evaluation, and illustrative test items 
6.10 Judgments in terms of internal evidence 


The major type of behavior for evaluation of this type 
of judgment is that the individual, when given a new work, 
is able to locate errors within it or is able to determine 
what in the document is treated in such a way that it may be 
regarded as internally consistent. Thus, when given a com- 
munication, the individual can judge it correctly as being 
consistent or inconsistent, accurate or inaccurate, carefully 
done or carelessly written, etc. In addition to making an 
over-all evaluation of the work with regard to accuracy, the 
test problem may be posed in such a manner that the indi- 
vidual is expected to cite the specific points within it which 
are accurate or inaccurate as well as the reasons why they 
are judged in this way. 


Although the individual may finally be expected to 
make some over-all evaluation as to accuracy, the testing 
problem is one of determining whether he is clearly aware 
of the specific ways in which the material is accurate and 
internally consistent or the flaws in it which make it inac- 
curate or inconsistent. It is possible for the testing to be 
concerned with relatively small problems in which each of 
the major types of possible errors or flaws may be tested 
separately. This type of testing may be used to infer 
or predict the individual's ability to evaluate larger works 
where many of these points are included in complex combi- 
nations. However, it would seem more economical from a 
testing viewpoint as well as more realistic and of higher 
face validity to test for evaluation of accuracy on whole 
problems which may involve evaluation of other types of ob- 


jectives as well, 
e 


The other major problem in testing for evaluation of 
accuracy is the question of tlie legitimacy of using recogni- 
tion types of questions. Quite frequently the multiple- 
choice or other recognition forms may call the examinee's 
attention to possible errors which he would not otherwise 
note. The use of recognition forms of questions for this 
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class of objectives or behaviors must depend on evidence 
that this technique is highly correlated with recall forms 
of questions on the same points as well as on the judg- 
ments of experts and other evidence that the mental proc- 
esses required are essentially those of evaluation about 
accuracy rather than reactions to stimuli and cues not 
clearly relevant to this type of objective. 


6.20 Judgments in terms of external criteria 


This type of evaluation requires that the individual 
have a relatively detailed knowledge of the class of phenom- 
ena under considegation, that he know the criteria custom- 
arily employed in judging such works or ideas, and that he 
have some skill in the application of these criteria. In a 
work of some complexity it is also necessary that the indi- 
vidual be able to comprehend and analyze the work before 
evaluating it. 


The testing of this intellectual ability requires that 
the individual be given some new work or idea to which spe- 
cific criteria or ends may be applied. The problem may 
vary from one in which the student is given a new work or 
idea and asked to evaluate it to problems which are more 
Specific in that the individual is asked to evaluate it as a 
member of a given class, or where he is asked to evaluate 
it in comparison with another given work. The problem may 
require that he make judgments of appropriate-inappropriate, 
good-bad, or judgments of the degree to which particular 
means-ends relationships are involved. 


The amount of knowledge required for many evaluation 
problems is very extensive, since the class of works, cri- 
teria for the class, ends to be served, as well as illustra- 
tions of the class must be clearly in mind before the individ- 
ual can apply external criteria to the judgment of a new work 
or idea. 


Althoügh a single final judgment may be an important 
aspect of the problem, the simple recording of such an over- 
all judgment is ordinarily insufficient evidence of the qual- 
ity of competence of the examinees in evaluation. It is fre- 
quently necessary to break down the problem into a series 
of rather specific judgments as well as analyses in order to 
be sure that the entire process of evaluation is a competent 
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one or in order to find the types of errors and difficulties 
encountered, 


The types of evaluation discussed here are not fre- 
quently used in secondary or collegiate education, As a 
result of the lack of emphasis on these objectives and be- 
haviors in the curriculum, little has been done to develop 
appropriate testing techniques. Some illustrations are 
available, but these are not the clearest or best techniques 
possible. Mogt frequently the testing techniques used are 
of the essay or recall type which do not focus sharply on 
the behaviors desired, They do give the examinee an op- 
portunity to demonstrate his competence, hut they do not 
necessarily evoke these behaviors; as a result, they are 
not very efficient testing procedures, Furthermore, 
available testing techniques do not permit much in the way 
of analysis of errors made or even a very detailed analy- 
sis of the methods by which such tests can be structured, 
Perhaps the greatest value of the taxonomy at this point 
is in pointing to the need for further study and develop- 
ment of testing techniques for measuring competence in 
evaluating documents, material, and works. 
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6.00 - EVALUATION -- ILLUSTRATIVE TEST ITEMS 


6.10 Judgments in terms of internal evidence 
Given a problem, determine a logical conclusion and judge the 


logical accuracy of statements in relation to the conclusion 


Social Security officials sometimes face perplexing problems in study- 
ing appeals for unemployment compensation, Some major-league base- 
ball players in Ohio and Missouri decided in January that, because they 
had not played ball since the end of the season, they had a right to con- 
sider themselves unemployed. Although some of them were earning 
good salaries of $8,000 to $10,000 a year in baseball, they maintained 
that they were entitled to the benefits of the unemployment section of 
the Social Security Act. 


Team owners urged {hese players not to apply for unemployment com- 
pensation. According to the owners! interpretation, the players were 
under contract all year around, although they worked and were paid 
only during the playing season. On the other hand, the state officials 

in Ohio and Missouri were inclined to agree with the players that they 
were entitled to benefit payments. 


Directions: Examine the conclusions given below. Assuming that 
the paragraphs above give a fair statement of the problem, which one 
of the conclusions do you think is justified, 


Conclusions 
A. The players were entitled to the benefits of the unemployment 
section of the Social Security Act. 
B. The players were not entitled to the benefits of the unemployment 
section of the Social Security Act. 
C. More information is needed to decide whether or not the players 


were entitled to the benefits of the unemployment section of the 
Social Security Act. 


A; Statements which explain why your conclusion is 
logical. 

Mark in B: Statements which do not explain why your conclu- 

column 8ion is logical. 

C: Statements about which you are unable to decide. 


Statements 
^ 
The state officials are the ones who consider appeals for unemploy- 


ment compensation, and their opinion carries more weight than the 
opinions of team owners, 


"m 


The Social Security Act may or may not provide that a man who 
works and receives pay during only part of each year is unemployed 
during the remaining part of the year, 
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The players argued indirectly (if others receive compensation, 
why shouldn't we?) and forgot that others needed the compen- 
sation more than they. 


A changed definition may lead to a changed conclusion even 
though the argument from each definition is logical. 


No one who earns $8,000 a year or more should get unemploy- 
ment compensation, 


(Source: PEA Test 5.12) 


6,20 Judgments in terms of external criteria 


Given possible bases for judgments about accuracy, recognize 
criteria which are appropriate. 


For items 6 - 11, assume that in doing research for a paper about the 
English language you find a statement by Otto Jespersen which contra- 
dicts some point of view on language which you have always accepted. 
Indicate which of the statements would be significant in determining the 
value of Jespersen's statement. For the purpose of these items, you 
may assume that these statements are accurate, 


Key: 


10. 


11. 


1. Significant positively--i.e., might lead you to trust his state- 
ment and to revise your own opinion, 

2, Significant negatively--i.e., might lead you to distrust his 
statement. 

3. Has no significance. 


Mr, Jespersen was Professor of English at Copenhagen 
University. 


The statement in question was taken from the very first 
article that Mr. Jespersen published, 


Mr. Jespersen's books are frequently referred to in other 
works that you consult. 


Mr. Jespersen's name is not included in the Dictionary of 
American Scholars. P 


So far as you can find, Jespersen never lived in England or 
the United States for any considerable period, 


In your reading of other authors on the English language, you 
find that several of them went to Denmark to study under 


Jespersen, 
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Given a poem, determine criteria of evaluation which are ap- 
propriate and apply them. 


12. Since there's no help, come let us kiss and part; 
Nay, I have done, you get no more of me, 
And I am glad, yea glad with all my heart 
That thus so cleanly I myself can free; 
Shake hands forever, cancel all our vows, 
And when we meet at any time again, 
Be it not seen in either of our brows 
That we one jot of former love retain. 
Now at the last gasp of love's latest breath, @ 
When, his pulse failing, passion speechless lies, 
When faith is kneeling by his bed of death, 
And innocence is closing up his eyes, 
Now if thou wouldst, when all have given him over, 
From deatl to life thou mightst him yet recover. 


Write an essay of from 250 to 500 words, describing and evaluating the 
foregoing poem. In your description you should employ such terms as 
will reveal your recognition of formal characteristics of the poem. 
Your principles of evaluation should be made clear--although they 
Should not be elaborately described or defended, 


Take time to organize your essay carefully. Save time for revisions 
and proof-reading so that the essay as it appears in your examination 
booklet represents your best intention. It is suggested that you give 
20 minutes to planning, 80 to writing, and 20 to revising your essay. 
Please try to write legibly. 


" 


Adi m 
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Given a means-ends relationship, judge its validity and support 
this judgment 


13. Essay I 


"The idea of liberty as formulated in the eighteenth century, al- 
though valid enough for that time, has in one fundamental respect ceased 
to be applicable to the situation in which we find ourselves, In the 
eighteenth century the most obvious oppressions from which men suf- 
fered derived from governmental restraints on the free activity of the 
individual. Liberty was therefore naturally conceived in terms of the 
emancipation ofthe individual from such restraints, In the economic 
realm this meant the elimination of governmental restraints on the 
individual in choosing his occupation, in contracting for the acquisition 
and disposal of property, and the purchase and sale of personal serv- 
ices, But in our time, as a result of the growingycomplexities ofa 
technological society, (a) the emancipation of the individual from gov- 
ernmental restraint in his economic activities has created new oppres- 
sions, so that (b) for the majority of men liberty can be achieved only 
by an extension of governmental regulation of competitive business 
enterprise." 


A. Defend or attack the truth of proposition (a) above. In doing this, 
take into consideration specific conditions in the areas of economic 
and political life in America from the Civil War to the present, 
(Suggested time; 15 minutes) 


Given an end, recognize the appropriateness of a articular m 
This assumes specific information about the phenomena involved, 


It may be worthwhile for the manufacturer of business goods to use 
space in consumer media solely to have the opportunity to reach those 
Peaders who as business men are interested in buying his product, Con- 
Sider,each of the following business goods, On the answer sheet, oppo- 
site the number which identified each product, blacken under column: 
A- if such an approach would appear to provide enough worth- 
while coverage to justify the expenditure; 
B- if such an approach would not be likely to reach enough good 


prospects to justify the expenditure. 


14, Chevrolet automobile 

15. National rock drills (mining industry) 
16, Remington typewriters 

17. Buckner textile machines 

18. Hammermill Bond Paper 
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Given an end, recognize best of several means 
19. 


Many people believe that it would be better if our states had more uni- 
form divorce laws. It is recognized, however, that there are dangers 
in an attempt to achieve such uniformity. Which one of the following 
procedures would be most likely to avoid the greatest of these dangers? 


A- An amendment to the U.S. Constitution is passed, which es- 
tablishes the grounds for divorce to be recognized in all courts. 

B- A federal law is passed which sets forth the maximum grounds 
which can be recognized by any state. 

C- A commission appointed by the President works'out standards 
for a divorce eode and encourages all states to consider these 
Standards in revising their laws. 

D- A conference of state governors decides on a divorce code and 
each governo attempts to have it made the law of his state. 

E- The U.S. Supreme Court establishes a uniform set of practices 
by ruling against all divorce laws which do not conform to its 
Standard. 


Given a particular end, determine the means which will serve it 


best 
20. 


Jane is faced with the problem of Selecting materialfor a school dress. 
The dress will receive lots of wear and will be laundered frequently. 
Which of the fabrics would be her best choice? (The test should include 
examples of fabrics, including some rayons. This would allow more 
reasons to be given below.) 


Check the qualities the fabric you choose possesses which make it supe- 
rior for Jane's purpose. 


(a) Material is colorfast to washing 

(b) Material is crease resistant 

(c) There is little or no sizing in the material, 
(d) Material is easily cared for 

(e) Material is soft and will drape easily 

(f) Weave is firm, close and smooth : 
(g) Material is colorfast to sunlight 


(h) Material will not show soil easily 


(i) Design is printed with the grain 
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APPENDIX 


Condensed Version of the 
Taxonomy of Educational Objectives 


Cognitive Domain 
KNOWLEDGE 
1,00 KNOWLEDGE 


Knowledge, as Gefined here, involves the recall of specifics and uni- 
versals, the recall of methods and processes, or the recall of a pattern, 
structure, or setting, For measurement purposes, the recall situation 
involves little more than bringing to mind the appropriate material, Al- 
though some alteration of the material may be reqilired, this is a rela- 
tively minor part of the task, The knowledge objectives emphasize most 
the psychological processes of remembering, The process of relating 
is also involved in that a knowledge test situation requires the organiza- 
tion and reorganization of a problem such that it will furnish the appro- 
priate signals and cues for the information and knowledge the individual 
possesses, To use an analogy, if one thinks of the mind as a file, the 
problem in a knowledge test situation is that of finding in the problem 
or task the appropriate signals, cues, and clues which will most effec- 
tively bring out whatever knowledge is filed or stored, 


1,10 KNOWLEDGE OF SPECIFICS 


The recall of specific and isolable bits of information. The em- 
phasis is on symbols with concrete referents, This material, 
which is at a very low level of abstraction, may be thought of as 
the elements from which more complex and abstract forms of 


knowledge are built, 


1.14 KNOWLEDGE OF TERMINOLOGY 


Knowledge of the referents for specific symbols (verbal and 
non-verbal). This may include knowledge of the most generally 
accepted symbol referent, knowledge of the variety of symbols 
which may be used for a single referent, or knowledge of the 
referent most appropriate to a giyen use of a symbol, 


4 *To define technical terms by giving their attributes, 
i properties, or relations. 


*Familiarity with a large number of words in their 
common range of meanings. 


112 KNOWLEDGE OF SPECIFIC FACTS 


Knowledge of dates, events, persons, places, etc, This may 
include very precise and specific information such as the 
Specific date or exact magnitude of a phenomenon, 1t may 
also include approximate or relative information such as an 


*Illustrative educational objectives selected from the literature, 
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approximate time period or the general order of magnitude of 
a phenomenon, 


*The recall of major facts about particular cultures, 


*The possession of a minimum knowledge about the organ- 
isms studied in the laboratory. 


1.20 KNOWLEDGE OF WAYS AND MEANS OF DEALING WITH 
SPECIFICS 


Knowledge of the ways of organizing, studying, judging, and criti- 
cizing. This includes the methods of inquiry, thetchronological 
sequences, and jhe standards of judgment within a field as well as 
the patterns of organization through which the areas of the fields 
themselves are determined and internally organized, This knowl- 
edge is at an intermediate level of abstraction between specific 
knowledge on the one hand and knowledge of universals on the other, 
It does not so much demand the activity of the student in using the 
materials as it does a more passive awareness of their nature. 


1.21 KNOWLEDGE OF CONVENTIONS 


Knowledge of characteristic ways of treating and presenting 
ideas and phenomena. For purposes of communication and con- 
sistency, workers in a field employ usages, styles, practices, 
and forms which best suit their purposes and/or which appear 
to suit best the phenomena with which they deal, It should be 
recognized that although these forms and conventions are likely 
to be set up on arbitrary, accidental, or authoritative bases, 
they are retained because of the general agreement or concur- 
rence of individuals concerned with the subject, phenomena, or 
problem. 


*Familiarity with the forms and conventions of the major 
types of works, e.g., verse, plays, scientific papers, etc. 


*To make pupils conscious of correct form and usage in 
speech and writing. 


1,22 KNOWLEDGE OF TRENDS AND SEQUENCES 


Knowledge of the processes, directions, and movements of 
phenomena with respect to time. 


*Understanding of the continuity and development of American 
culture as exemplified in American life. 


*Knowledge of the basic trends underlying the development of 
public assistance programs, 
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1.23 KNOWLEDGE OF CLASSIFICATIONS AND CATEGORIES 


Knowledge of the classes, sets, divisions, and arrangements 
which are regarded as fundamental for a given subject field, 
purpose, argument, or problem, 
*To recognize the area encompassed by various kinds of 
problems or materials, 


*Becoming familiar with a range of types of literature, 


1.24 KNOWL/ZDGE OF CRITERIA 


Knowledge of the criteria by which fact®, principles, opin- 
ions, and conduct are tested or judged. 


*Familiarity with criteria for judgment appropriate to the 
type of work and the purpose for which it is read, 


*Knowledge of criteria for the evaluation of recreational 
activities. 


1.25 KNOWLEDGE OF METHODOLOGY 


Knowledge of the methods of inquiry, techniques, and proce- 
dures employed in a particular subject field as wellas those 
employed in investigating particular problems and phenomena, 
The emphasis here is on the individual's knowledge of the 
method rather than his ability to use the method. 
*Knowledge of scientific methods for evaluating health 
concepts. 
*The student shall know the methods of attack relevant to 
the kinds of problems of concern to the social sciences. 


1.30 KNOWLEDGE OF THE UNIVERSALS AND ABSTRACTIONS IN 


= 


* 


A FIELD 


Knowledge of the major schemes and patterns by which phenomena 
and ideas are organized. These are the large structures, theories, 
and generalizations which dominate a subject field or which are 
quite generally used in studying phenomena or solving problems. 
These are at the highest levels of abstraction and complexity. 


1, dd KNOWLEDGE OF PRINCIPLES AND GENERALIZATIONS 


Knowledge of particular abstractions which summarize obser- 
vations of phenomena, These are the abstractions which are of 
value in explaining, describing, predicting, or in determining 
the most appropriate and relevant action or direction to be taken, 


*Knowledge of the important principles by which our ex- 
perience with biological phenomena is summarized. 


*The recall of major generalizations about particular 
cultures. 
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1,32 KNOWLEDGE OF THEORIES AND STRUCTURES 


Knowledge of the body of principles and generalizations together 
with their interrelations which present aclear, rounded, and 
systematic view of a complex phenomenon, problem, or field, 
These are the most abstract formulations, and they can be used 
to show the interrelation and organization of a great range of 
specifics, 

*The recall of major theories about particular cultures, 


*Knowledge of a relatively complete formulation of the 


theory of evolution, 
© 


a EE ET UAT ABILITIES AND SKILLS 


Abilities and skills refer to organized modes of operation and general- 
ized techniques for dealing with materials and problems, The materials 
and problems may be of such a nature that little or no specialized and 
technical information is required, Such information as is required can 
be assumed to be part of the individual's general fund of knowledge. 
Other problems may require specialized and technical information at a 
rather high level such that specific knowledge and skill in dealing with 
the problem and the materials are required, The abilities and skills 
objectives emphasize the mental processes of organizing and reorganiz- 
ing material to achieve a particular purpose, The materials may be 
given or remembered, 


2.00 COMPREHENSION 


This represents the lowest level of understanding. It refers to a 
type of understanding or apprehension such that the individual 
knows what is being communicated and can make use of the mate- 
rial or idea being communicated without necessarily relating it to 
other material or seeing its fullest implications, 


2.10 TRANSLATION 


Comprehension as evidenced by the care and accuracy with 
which the communication is paraphrased or rendered from one 
one language or form of communication to another, Transla- - 
tion is judged on the basis of faithfulness and accuracy, that is, 
on the extent to which the material in the original communica- 
tion is preserved although the form of the communication has 
been altered, 


*The ability to understand non-literal statements 
(metaphor, symbolism, irony, exaggeration), 


*Skill in translating mathematical verbal material 
into symbolic statements and vice versa, 
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2,20 INTERPRETATION 


The explanation or summarization of a communication, Where- 
as translation involves an objective part-for-part rendering of 
a communication, interpretation involves a reordering, re- 
arrangement, or a new view of the material, 


*The ability to grasp the thought of the work as a whole 
at any desired level of generality, 


*The ability to interpret various types of social data, 


€ 
2,30 EXTRAPOLATION 


3.00 


4.00 


e 
The extension of trends or tendencies beyond the given data to 
determine implications, consequences, corollaries, effects, 
etc., which are in accordance with the conditions described in 
the original communication, 

*The ability to deal with the conclusions of a work in terms 
of the immediate inference made from the explicit state- 
ments, 

*Skill in predicting continuation of trends, 


APPLICATION 


The use of abstractions in particular and concrete situations, The 
abstractions may be in the form of general ideas, rules of proce- 
dures, or generalized methods, The abstractions may also be 
technical principles, ideas, and theories which must be remem- 
bered and applied, 
*Application to the phenomena discussed in one paper of 
the scientific terms or concepts used in other papers. 


*The ability to predict the probable effect of a change in a 
factor on a biological situation previously at equilibrium, 


ANALYSIS 


The breakdown of a communication into its constituent elements or 
parts such that the relative hierarchy of ideas is made clear and/or 
the relations between the ideas expressed are made explicit, Such 
analyses are intended to clarify the communication, to indicate how 
the communicgtion is organized, and the way in which it manages 

to convey its effects, as well as its basis and arrangement, 


4,10 ANALYSIS OF ELEMENTS 


Identification of the elements included in a communication, 
*The ability to recognize unstated assumptions, 
*Skill in distinguishing facts from hypotheses. 
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4.20 ANALYSES OF RELATIONSHIPS 


The connections and interactions between elements and parts 
of a communication, 


*Ability to check the consistency of hypotheses with 
given information and assumptions, 


*Skil in comprehending the interrelationships among 
the ideas in a passage. 


4.30 ANALYSIS OF ORGANIZATIONAL PRINCIPLES 


The organization, systematic arrangement, and structure 
which hold the communication together, This includes the 
"explicit" as well as "implicit" structure. It includes the 
bases, necgssary arrangement, and the mechanics which 
make the communication a unit, 


*The ability to recognize form and pattern in literary or 
artistic works as a means of understanding their meaning, 


*Ability to recognize the general techniques used in persua- 
sive materials, such as advertising, propaganda, etc, 


5.00 SYNTHESIS 


The putting together of elements and parts so as to form a whole. 
This involves the process of working with pieces, parts, elements, 
etc., and arranging and combining them in such a way as to con- 
Stitute a pattern or structure not clearly there before. 


5.10 PRODUCTION OF A UNIQUE COMMUNICATION 


The development of a communication in which the writer or 
speaker attempts to convey ideas, feelings, and/or experi- 
ences to others. 


*Skill in writing, using an excellent organization of ideas 
and statements. 


*Ability to tell a personal experience effectively. 
5.20 PRODUCTION OF A PLAN, OR PROPOSED SET OF 
OPERATIONS 5 


The development of a plan of work or the proposal of a plàn of 
operations, The plan should satisfy requirements of the task 
which may be given to the student or which he may develop for 
himself. 


*Ability to propose ways of testing hypotheses. 


*Ability to plan a unit of instruction for a particular 
teaching situation, 
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5.30 DERIVATION OF A SET OF ABSTRACT RELATIONS 


The development of a set of abstract relations either to classify 
or explain particular data or phenomena, or the deduction of 
propositions and relations from a set of basic propositions or 
symbolic representations. 

*Ability to formulate appropriate hypotheses based upon an 
analysis of factors involved, and to modify such hypothe- 
ses in the light of new factors and considerations, 

*Ability to make mathematical discoveries and generalizations. 

e 


6.00 EVALUATION 6 


Judgments about the value of material and methods for given pur- 
poses, Quantitative and qualitative judgments v the extent to 
which material and methods satisfy criteria. Use of a standard 
of appraisal, The criteria may be those determined by the stu- 
dent or those which are given to him, 


6.10 JUDGMENTS IN TERMS OF INTERNAL EVIDENCE 
Evaluation of the accuracy of a communication from such evi- 
dence as logical accuracy, consistency, and other internal 
criteria. 

*Judging by internal standards, the ability to assess gen- 


eral probability of accuracy in reporting facts from the 
care given to exactness of statement, documentation, 


proof, etc. 
*The ability to indicate logical fallacies in arguments. 


6.20 JUDGMENTS IN TERMS OF EXTERNAL CRITERIA 


Evaluation of material with reference to selected or re- 
membered criteria. 
*The comparison of major theories, generalizations, 
and facts about particular cultures. 
*Judging by external standards, the ability to compare a 
work with the highest known standards in its field-- 
especially with other works of zecognized excellence, 
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